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PREFACE 


Applied mathematics comes down ultimately to numerical results, and 
the student of any branch of applied mathematics will do well to supple- 
ment his usual mathematical equipment with a definite knowledge of the 
numerical side of mathematical analysis. He should, in particular, be able 
to estimate the reliability of any numerical result he may arrive at. The 
object of this book is to set forth in a systematic manner and as clearly as 
possible the most important principles, methods, and processes used for 
obtaining numerical results; and also methods and means for estimating 
the accuracy of such results. The book is concerned only with fundamental 
principles and processes, and is not a treatise on computation. For this 
reason little attention is paid to computation forms, the assumption being 
that the reader who has much computation of a particular kind to do will 
be able to devise his own form. 

The plan of treatment followed throughout the book may be briefly 
stated as follows : Each major subject or topic is introduced by a short 
statement of “ what it is all about.’’ Then follows a brief statement of the 
underlying theory of the subject under consideration. With this theory 
as a basis, the processes and formulas are then developed in the simplest 
and most direct manner. Formulas and methods for checkmg or esti- 
mating the accuracy of results are also worked out wherever possible. The 
reader is then shown just how to use the formulas and processes developed, 
by applying them to a variety of examples. Finally, the limitations of the 
formulas and the pitfalls connected with the processes are carefully pointed 
out by means of appropriate examples. Notes and remarks are also added 
wherever they will throw further light on the subjects under consideration. 

The treatment of all topics has been made as elementary as was con- 
sistent with soundness, and in some instances the explanations may seem 
unnecessarily detailed. For such detailed explanations no apology is 
offered, as the book is meant to be understood with a minimum of effort 
on the part of the reader. Moreover, experience in teaching certain topics 
has shown that even a good student must receive considerable assistance 
from teacher, textbook, or some other source. I have tried everywhere to 
clear up the difficulties before the student meets them, so that no teacher 
or other source of information will be needed. In order to make the book 
everywhere as readable as possible I have purposely refrained from using 
notations peculiar to certain subjects, and from employing synibolic methods 
and divided differences in deriving the standard formulas of interpolation. 

vii 
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A knowledge of calculus to the extent of the usual first course is all that 
is needed for the understanding of anything in the book. 

The more important formulas throughout the book are numbered in 
heavy black type to distinguish them from those of less importance. 

The worker who is to obtain numerical results with a minimum of 
effort must provide himself with every possible aid for lessening the labor 
of his task. In addition to such aids as slide rules, computing machines, 
and logarithmic tables, the computer will find that Barlow’s tables of 
squares, cubes, etc., and the Smithsonian Mathematical Tables are prac- 
tically indispensable. Crelle’s ‘^ Calculating Tables,” Jahnke and Emde’s 
“ Funktionentafeln,” and Jordan’s “Opus Palatinum” (tables of natural 
sines and cosines to seven decimal places) will also prove their worth in 
many instances. 

In the preparation of the book 1 have consulted the writings of the 
majority of previous writers on the subjects treated, and am indebted to 
many of them for ideas and methods; but my greatest debt is to the 
writings of the late and great Carl Bunge, who undoubtedly contributed 
more to numerical mathematical analysis than any other man since Gauss. 
References to the works of other writers will be found here and there in 
the text and in footnotes. 

It is a pleasure to record my thanks to the U. S. Naval Institute for 
permission to use certain copyrighted material which I originally prepared 
for Engineering Mathematics (1925, 1926) ; to Dr. L. M. Kells, of the 
U. S. Naval Academy, for helpful criticism on parts of the manuscript; 
and to the Johns Hopkins Press and the George Banta Publishing Company 
for their hearty cooperation in meeting my wishes concerning the make-up 
and publication of the book. 

J. B. Scarborough 

Annapolis, Md. 

November, 1980 
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CHAPTER I 

THE ACCURACY OF APPROXIMATE CALCULATIONS 

1. Introduction. Since applied mathematics comes down ultimately to 
numerical results^ the worker in applied mathematics will encounter all 
kinds of numbers and all kinds of formulas. He must be able to use the 
numbers and evaluate the formulas so .as to get the best possible result in 
any situation. What he learned about numerical calculation in his earlier 
study of arithmetic is inadequate for handling the numerical side of applied 
mathematics. For example, the numerical data used in solving the prob- 
lems of everyday life are usually not exact, and the numbers expressing 
such data are therefore not exact. They are merely approximations, true 
to two, three, or more figures. 

Not only are the data of practical problems usually approximate, but 
sometimes the methods and processes by which the desired result is to 
be found are also approximate. An approximate calculation is one which 
involves approximate data, approximate methods, or both. 

It is therefore evident that the error in a computed result may be due 
to one or both of two sources : errors in the data and errors of calculation. 
Errors of the first type cannot be remedied, but those of the second type 
can usually be made as small as we please. Thus, when such a number as 
TT is replaced by its approximate value in a computation, we can decrease 
the error due to the approximation by taking tt to as many figures as 
desired, and similarly in most other cases. We shall therefore assume in 
this chapter that the calculations are always carried out in such a manner 
as to make the errors of calculation negligible. 

Nearly all numerical calculations are in some way approximate, and the 
aim of the computer should be to obtain results consistent with the data 
with a minimum of labor. The object of the present chapter is to set 
forth some basic ideas and methods relating to approximate calculations 
and to give methods for estimating the accuracy of the results obtained. 
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2. Approximate Numbers and Significant Figures. 

(a) Approximate Numbers. In the discussion of approximate compu- 
tation, it is convenient to make a distinction between numbers which are 
absolutely exact and those which express approximate values. Such 
numbers as 2, 1/3, 100, etc. are exact numbers because there is no approxi- 
maticm or uncertainty associated with them. Although such numbers as 
TT, V2, e, etc. are exact numbers, they cannot be expressed exactly by a 
finite number of digits. When expressed in digital form, they must be 
written as 3.1416, 1.4142, 2.7183, etc. Such numbers are therefore only 
approximations to the true values and in such cases are called approximate 
numbers. An approximate number is therefore defined as a number which 
is used as an approximation to an exact number and differs only slightly 
from the exact number for which it stands.* 

(b) Significant Figures. A significant figure is any one of the digits 
1,2,3,- • -9; and 0 is a significant figure except when it is used to fix 
the decimal point or to fill the places of unknown or discarded digits. 
Thus, in the number 0.00263 the significant figures are 2, 6, 3 ; the zeros 
are used merely to fix the decimal point and are therefore not significant. 
In the number 3809, however, all the digits, including the zero, are signifi- 
cant figures. In a number like 46300 there is nothing in the number as 
written to show whether or not tilt zeros are significant figures. The 
ambiguity can be removed by writing the number in the powers-of-ten 
notation as 4.63 X lOS 4.630 X 10", or 4.6300 X10", the number of 
significant figures being indicated by the factor at the left. 

3. Rounding of Numbers. If we atienipt to divide 27 by 13.1, we get 
27/13.1 = 2.061068702- • 

a quotient which never terminates. In order to use such a number in a 
practical computation, we must cut it down to a manageable form, such 
as 2.06, or 2.061, or 2.06107, etc. This process of cutting off superfluous 
digits and retaining as many as desired is called rounding off. 

To round off or simply round a number is to retain a certain number 
of digits, counted frcm the left, and drop the others. Thus, to round off ir 
to three, four, five, and six figures, resjiectively, we have 3.14, 3.142, 
3.1416, 3.14159. Numbers are rounded off so as to cause the least possible 
error. This is attained by rounding according to the following rule: 

* Some readers may object to the term “ approximate number ” and insist that one 
should always say “ approximate value *’ of a number. The shorter term, however, 
is less cumbrous, is perfectly definite as defined above, and reminds us by its very 
name that it stands for the approximate value of a number. It has been used in 
this sense by no less an authority than Jules Tannery in his Le^ong d*Arithm4tique, 
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To round oflf a number to n significant figures, discard all digits to the 
right of the nth place. If the discarded number is less than half a unit 
in the nth place, leave the nth digit unchanged; if the discarded number 
is greater than half a unit in the nth place, add 1 to the nth digit. If 
the discarded number is exactly half a unit in the nth place, leave the nth 
digit unaltered if it is an even number, but increase it by 1 if it is an 
odd number; in other words, round off so as to leave the nth digit an 
even number in such cases. 

When a number has been rounded off according to the rule just stated, 
it is said to be correct to n significant figures. 

The following numbers are rounded off correctly to four significant 
figures : 


29.63243 

becomes 29.63 

81.9773 

cc 

81.98 

4.4995001 

cc 

4.500 

11.64489 

u 

11.64 

48.365 

u 

48.36 

67.495 

(4 

67.50 


When the above rule is followed consistently, the errors due to rounding 
are largely cancelled by one another. 

Such is not the case, however, if the computer follows an old rule which 
is sometimes advocated. The old rule says that when a 5 is dropped the 
preceding digit should always be increased by 1. This is bad advice and 
is conducive to an accumulation of rounding errors and therefore to 
inaccuracy in computation. It should be obvious to any thinking person 
that when a 5 is cut off, the preceding digit should be increased by 1 in 
only half the cases and should be left unchanged in the other half. Since 
even and odd digits occur with equal frequency, on the average, the rule 
that the odd digits be increased by 1 when a 5 is dropped is logically sound. 

The case where the number to be discarded is exactly half a unit in the 
nth place deserves further comment. From purely logical considerations 
the digit preceding the. discarded 5000 • • • might just as well be left odd, 
but there is a practical aspect to the matter. Rounded numbers must often 
be divided by other numbers, and it is highly desirable from the stand- 
point of accuracy that the division be exact as often as possible. An even 
number is always divisible by 2, it may be divisible by other even numbers, 
and it may also be divisible by several odd numbers; whereas an odd 
number is not divisible by any even number and it may not be divisible by 
any odd number. Hence, in general, even numbers are exactly divisible 
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by many more numbers than are odd numbers, and therefore there will 
be fewer left-over errors in a computation when the rounded numbers are 
left even. The rule that the last digit be left even rather than odd is 
thus conducive to accuracy in computation. 

In certain rare instances the rule for cutting off 50000 • • • should be 
modified. For example, if a 5 is to be cut off from two or more numbers 
in a column that is to be added, the preceding digit should be increased 
by 1 in half the cases and left unchanged in the other half, regardless of 
whether the preceding digit is even or odd. Other cases might arise 
where common sense should be the guide in making the errors neutralize 
one another. 

4. Absolute, Relative, and Percentage Errors. The absolute error of 
a number, measurement, or calculation is the numerical difference between 
the true value of the quantity and its approximate value as given, or 
obtained by measurement or calculation. The relative error is the absolute 
error divided by the true value of the quantity. The percentage error is 
100 times the relative error. For example, let Q represent the true value 
of some quantity. If is the absolute error of an approximate value 
of Q, then 

AQ/Q = relative error of the approximate quantity. 

IOOAQ/Q == percentage error of the approximate quantity. 

If a number is correct to n significant figures, it is evident that its 
absolute error can not be greater than half a unit in the nth place. For 
example, if the number 4.629 is correct to four figures, its absolute error 
is not greater than 0.001 X i = 0.0005. 

Remark. It is to be noted that relative and percentage errors are 
independent of the unit of measurement, whereas absolute errors are 
expressed in terms of the unit used. 

5. Relation between Relative Error and the Number of Significant 
Figures. The belief is widespread, even in scientific circles, that the 
accuracy of a measurement or of a^ computed result is indicated by the 
number of decimals required to exjinvss it. This belief is erroneous, for 
the accuracy of a result is indicated by the number of significant figwres 
required to express it. The true index of the accuracy of a measurement 
or of a calculation is the relative error. For example, if the diameter of 
a 2-inch steel shaft is measured to the nearest thousandth of an inch, the 
result is less accurate than the measurement of a mile of railroad track 
to the nearest foot. For although the absolute errors in the two measure- 
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ments are 0.0005 inch and 6 inches, respectively, the relative errors are 
0.0005/2 -= 1/4000 and 1/10,560. Hence in the measurement of the shaft 
we make an error of one part in 4000, whereas in the case of the railroad 
we make an error of one part in 10,560. The latter measurement is clearly 
the more accurate, even though its absolute error is 12,000 times as great. 

The relation between the relative error and the number of correct figures 
is given by the following fundamental theorem : 

Theorem L If the first significant figure of a number is k, and the 
number is correct to n significant figures, then the relative error is less 
than l/(k X 10“-"). 

Before giving a literal proof of this theorem we shall first show that it 
holds for several numbers picked at random. Henceforth we shall denote 
absolute and relative errors of numbers by the symbols Fa and Fr, 
respectively. 

Fxample 1. Let us suppose that the number 864.32 is correct to five 
significant figures. Then fc = 8, n = 5, and Fa ^ 0.01 X i = 0.005. For 
the relative error we have 

^ 0.005 _ 5 ___ J 

= 864.32— 0.005 864320 — 5 2 X «6432 — 1 

= ?: i 1 . 

2(86432 — i) ^2 X 8 X 10" 8 X 10* 

Hence the theorem holds here. 

Fxample 2. .Next, let us consider the number 369,230. Assuming that 
the last digit (the zero) is written merely to fill the place of a discarded 
dmit and is therefore not a significant figure, we have k = 3. n = 5, and 
^ 10 X i = 5. Then 

< 5 1_ 

= 369230 — 5 2 X. 36923 

2 X 3 X 10' *^3 X ’ 

Fxample S. Finally, suppose the number 0.0800 is correct to three 
significant figures. Then k = S, n — 3, Fa^ 0.0001 X i == 0.00005, and 

0.00005 5 1 

== 0.0800 -- 0.00005 ~ 8000 — 5 “ 1 600 — 1 
1 


_ 1 

— J 2(36923 — i) 


1 
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It is to be noted that in this exain^ple the relative error is not certainly 
less than 1/(2A; X as was the case in Examples 1 and 2 above. 

To prove the theorem generally, let 

N «= any number (exact value), 
n = number of correct significant figures, 
m = number of correct decimal places. 

Three cases must be distinguished, namely m <C n, m ^n, and m n. 

Case 1. m a n. Here the number of digits in the integral part of N 
is n — 771. Denoting the first significant figure of N by k, as before, we 
have 

Ea ^ 1/10”^ X N^kX — 1/10"» X h 

Hence 

^ 1/10" X i 10;;::: 

A; X — 1/10"^ X i 2k X lO'^"' X lO'”' — lO'”* 

^ 1 1 

2k X 10”-' — 1 2 (A; X 10”*' — |) ' 

Remembering now that n is a positive integer and that k stands for any 
one of the digits from 1 to 9 inclusive, we readily see that 2A; X 10"^^ — 1 
> k X 10”“^ in all cases except A: = 1 and n =* 1. But this is the trivial 
case where iV = 1, 0.01, etc. ; that is, where N contains only one digit 
different from zero and this digit is 1 — a case which would never occur 
in practice. Hence for all other cases we have 2 A: X 10”"^ — 1 > A; X 10”"/. 
and therefore 

^ k X 10"-’ 

Case 2. in = n. Here N is a, decimal and k is the first decimal figure. 
We then have 

Ea ^ I/IO"* xh N^kX 10-‘ — l/io™ X h 

. „ ^ 10-’" X i 10:::: i 

it X 10-‘ — 10-’" X i 2A; X 10-* — 10 2ikX10"-‘ — 1 

i 

Zk X lO""' — 1 * X 10"-* 

Case 3. m'> n. In this case k occupies the (m — n + l)th decimal 

place and therefore 
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N'^hX — I/IO” Xi, 1/10’" X i- 

. „ < 10~” X h IOC!: 

■ JcX lO"*" X 10"“* — 10-*" X i 2fc X ]0-’" X 10"-" — 10-’” 

3 

2k X 10"-" — 1 ^ A: X 10"-" 

The theorem is therefore true in all cases. 

Corollary 1. Except in the case of approximate numbers of the form 
A; ( 1.000 ■ • •)X 10^, in which k is the only digit different from zero, the 
relative error is less than 1/(2A; X 10”"^). 

Corollary 2. If A; ^ 5 and the given approximate number is not of the 
form A;(1.000 • ■ *)X 1^^ then Er < I/IO'^; for in this case 2A; ^ 10 and 
therefore 2A; X 10"~^ ^ 10”. 

To find the number of correct figures corresponding to a given relative 
error we can not take the converse of the theorem stated at the beginning 
of this aiticle, for the converse theorem is not true. In proving the 
formula for the relative error we took the lower limit for N in order to 
obtain the upper limit for Er^ Thus, for the lower limit of N we took 
its first significant figure multiplied by a power of 10. In the converse 
problem of finding the number of correct figures corresponding to a given 
relative error we must find the upper limit of the absolute error Ea\ 
and since Ea = E'Er, we should use the upper limit for N. This upper 
limit will be k -f- 1 times a power of 10, where k is the first significant 
figure in N. For example, if the approximate value of N is 6895, the 
lower limit to used in finding the relative error is 6 X 10®. whereas the 
upper limit to be used in finding the absolute error is 7 X 10®. 

To solve the converse problem we utilize Theorem II : 

Theorem II. If the relative error in an approximate number is less 
than l/[(k + 1) X 10”"^], the number is correct to n significant figures, 
or at least is in error by less than a unit in the nth significant figure. 

To prove this theorem let 

N = the given number (exact value), 
n == number of correct significant figures in N, 
k = first significant figure in N, 
p = number of digits in the integral part of N. 

Then 

fi — p number of decimals in N, 
and iVg + 1)X 
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Let 


Then 


(i + l)X lO*-' ■ 




JQn-p 


Now 1/10"“P is one unit in the (n — />)th decimal place, or in the nth 
significant figure. Hence the absolute error Ea is less than a unit in the 
nth significant figure. 

If the given number is a pure decimal, let 

p = number of zeros between the decimal point and first significant 
figure. Then n p number of decimals in N, and 


jrstf + I) 


Hence if 


we have 


Er< 


E < X 


1 

{k + l)x 10 -^ 
1 


(A: + 1)X 


1 


But 1/10”^ is one unit in the (n-fp)th decimal place, or in the nth 
significant figure. Hence the absolute error Ea is less than a unit in the 
nth significant figure. 

Corollary 3, If Er < l/[2(fc -f- ^)X then Ea is less than half 

a unit in the nth significant figure and the given number is correct to n 
significant figures in all cases. 

Corollary Jf. Since Ic may have any value from 1 to 9 inclusive, it is 
evident that A; + 1 value -from 2 to 10. Hence the upper 

and lower limits of the fraction 1/[2(A; -f- 1)X are 1/(4 X 10”"^) 

and 1/(2 X 10”)> respectively. We can therefore assert that 


If the relative error of any number is not greater than 1/(2 X 10") the 
number is certainly correct to n significant figures. 

Remark. The reader can readily see from the preceding discussion that 
the absolute error is connected with the number of decimal places, whereas 
the relative error is connected with the number of significant figures. 


6. The General Formula for Errors. Let 

(1) N = f(Ui,U2,U^r • -Un) 
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denote any function of several independent quantities which 

are subject to the errors Ai^i, Auz, • * • respectively. These errors in 
the uh will cause an error AiV’ in the function N, according to the relation 

(2) + AiV == /(Wi + AWi, U 2 + ^U2, • • • -Wn + AWn). 

To find an expression for we must expand the right-hand member 
of (2) by Taylor’s theorem for a function of several variables. Hence 
we have 

df 

/(Wl + AUi, U2 + A?/., ‘ ' 'IK + AUn) = f{Ui, Z^2, • • ■ Un) + 

- ■J+- - ■ 

Now since the errors Aw-i, Mu, • • * AWn are always relatively small,* we 
may neglect their squares, products, and higher powers and write 

(3) N + AN == f{Ui,U2, Us, ’ ‘ Un) 

' CUi duo dUn 

Subtracting (1) from (3), we get 


AN Aui + ^ A?U‘ + ‘ ‘ ‘ + ^ AtZn, 

dui du2 dUn 


or 


dN dN dN dN 

(6. 1) AA^ - - Aw, + + • • • + ^ Aun. 

^ du, du2 dus dUn 


This is the general formula for computing the error of a function, and 
it includes all possible cases. It will be observed that the right-hand 
member of (6. 1) is merely the total differential of the function N. 

For the relative error of the function N we have 


( 6 . 2 ) 



dN Aui dN Au.j dN Au^ 

aTi F” ^ IT + ■ ■ ■ * 


When N is a function of the form 


(6.3) 


N = 


Ka^h^cP 


* A quantity P is said to be relatively small in comparison with a second quantity 
Q when the ratio P/Q is rmall in comparison with unity. The squares and products 
of such small ratios ars negligible in most calculations. 
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then by (6. 2) the relative error is 

Er ^N/N m(Aa/a) + n(A&/&) -f p{Ac/c) — q{Ad/d) — r{Ae/e), 

But since the errors Aa, • • * Ae, etc. are just as likely to be negative as 
positive, we must take all the terms with the positive sign in order to be 
sure of the maximum error in the function N. Hence we write 

(6. 4) Er ^ m \ Aa/a \ -\- n\ Ab/b ( + P I ^c/c | + ? | Ad/d | + r | Ae/e [ . 

7. Application of the Error Formulas to the Fundamental Operations 
of Arithmetic and to Logarithms. We shall now apply the preceding 
results to the fundamental operations of arithmetic. 

7a). Addition. Jjet 

iY = Ui + W2 + * • ' + Un. 

Then 

(7.1) AN == Ea = AUl -j- AU2 AUn* 

The absolute error of a sum of approximate numbers is therefore equal to 
the algebraic sum of their absolute errors. 

The proper way to add approximate numbers of different accuracies is 
shown in the two examples below. 

Example 1. Find the sum of the approximate numbers 561.32, 491.6, 
86.954, and 3.9462, each being correct to its last figure but no farther. 

Solution. Since the second number is known only to the first decimal 
place, it would be useless and absurd to retain more than two decimals 
in any of the other numbers. Hence we round them off to two decimals, 
add the four numbers, and give the result to one decimal place, as shown 
below : 

491.6 

561.32 

86.95 

3.95 

1143.8 

By retaining two decimals in the more accurate numbers we eliminate 
the errors inherent in these numbers and thus reduce the error of the sum 
to that of the least accurate number. The final result, however, is uncertain 
by one unit in its last figure. 

Example 2. Find the sum of 36490, 994, 557.32, 29500, and 86939, 
assuming that the number 29500 is known to only three significant figures. 
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Solution. Since one of the numbers is known only to the nearest hundred, 
we round off the others to the nearest ten, add, and give the sum to hun- 
dreds, as shown below : 

29500 

86940 

36490 

990 

560 


154500 or 1.545 X 10*. 

The result is uncertain by one unit in the last significant figure. 

In general, if we find the sum of m numbers each of which has been 
rounded off correctly to the same place, the error in the sum may be as 
great as m/2 units in the last significant figure. 

7h). Averages. An important case in the addition of numbers must 
here be considered. Suppose we are to find the mean of several approxi- 
mate numbers. Is this mean reliable to any more figures than are the 
numbers from which it was obtained? The answer is yes, but in order to 
see why let us consider the following concrete case. 

The first column below contains the mantissas of ten consecutive 
logarithms taken from a six-place table. The second column contains these 
same mantissas rounded off to five decimals. The third column gives the 
errors due to rounding, expressed in units of the sixth decimal place. 


N 

0.961421 

0.961469 

0.961516 

0.961563 

0.961611 

0.961658 

0.961706 

0.961753 

0.961801 

0.961848 

Average, 0.9616346 Av. 

= 0.961635 


N' 

E 

0.96142 

1 

0.96147 

— 1 

0.96152 

— 4 

0.96156 

3 

0.96161 

1 

0.96166 

— 2 

0.96171 

— 4 

0.96175 

3 

0.96180 

1 

0.96185 

— 2 

0.961635 

Sum, — 4 


Av., — 0.4 


Here we have the relation 


N — N' + E 
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for each of the numbers and therefore the further relations 


and 


= :iN' + 1.E 

l,N/n =* l,Nyn + S^^/n. 


It will be noticed that the average of the rounded numbers is in error 
by only 0.4 of a unit in the sixth decimal place. We may therefore call it 
correct to six decimals^ or to one more place than the rounded numbers. 

The entries in all numerical tables and the results of all measurements 
are rounded numbers in which the error is not greater than half a unit 
in the last significant figure. These errors (due to rounding) are in 
general as likely to be positive as negative and hence their algebraic sum 
is never large. Usually it i? less than a unit in the last figure. 

The foregoing considerations justify the computer in retaining one more 
figure in the mean of a set of numbers than are given in the numbers 
themselves. But rarely should he retain the mean to more than one 
additional figure. 

7c). Subtraction, Here 


and 


N — U2 


(7. 2) AN=^Ea===Au^ — Au2. 

Since the errors Aui and Aua may be either positive or negative, however, 
we must take the sum of the absolute values of the errors in order to get 
the maximum error. We then have the result that the absolute error of 
the difference of two approximate numbers may equal the sum of their 
absolute errors. 

When one approximate number is to be subtracted from another, they 
must both be rounded off to the same place before subtracting. Thus, to 
subtract 46.365 from 779.8, assuming that each number is approximate and 
correct only to its last figure, we have 

779.8 — 46.4 = 733.4. 


It would be absurd to write 779.800 — 46.365 = 733.435, because the last 
two figures in the larger number as here written are not zeros. 

7d). Loss of Significant Figures by Subtraction. 

The most serious error connected with the subtraction of approximate 
numbers arises from the subtraction of numbers which are nearly equal. 
Suppose, for example, that the numbers 64.395 and 63.994 are each correct 
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to five figurt'S, but no more. Their difference, 64.395 — 63.994 — 0.401, 
is correct to only three figures. Again, if the numbers 16950 and 16870 
are each correct to only four significant figures, their difference 16950 — 
16870 = 80 is correct to only one significant figure, and even this figure 
may be in error by one unit. 

Errors arising from the disappearance of the most important figures on 
the left, as in the two examples of the preceding paragraph, are of frequent 
occurrence and sometimes render the result of a computation worthless. 
They must be carefully guarded against and eliminated wherever possible. 

The inaccuracy resulting from the loss of the most important significant 
figures in the subtraction of tw'o nearly equal numbers can be lessened, and 
sometimes entirely avoided, in one of two ways : 

1. By approximating each of the numbers with sufficient accuracy 
before subtraction, when this is possible. Thus, to find the difference 
V2.03 — correct to five significant figures, we take y/2.03 = 1.424781 
and = 1.414214. Then 1.424781 — 1.414214 = 0.010567. Note that 
a slide-rule computation is worthless in such a case as this. 

This method is limited when the two given numbers are approximate and 
true to only a few digits. 

2. By transforming the expression whose value is desired. Thus, to find 
the value of 1 — cos x w^hen x is small and no extended table is at hand, 
write 1 — cosrr = 2sin^ (^/^) in some cases, and in other cases replace 
cos X by its Taylor expansion. Then 


1 


cos X ■■ 


1-(1 


2 4 ! 




In finding the area of a circular segment having a small central angle, 
replace sin ^ by its Taylor expansion. Thus 


R^ 6'^ 6'^ 

A,ea = -'^- (0-sin^)=--[0-(/?---f ---- • ■)] 

_ \ 

“ 2 \ 6 120 + ■ ■ 7 ’ 

otherwise the area of a plainly visible segment might turn out to be zero 
when 4- or 5-place tables are used. 

Sometimes in the evaluation of such an expression as \/ a — '\/b, where 
h is only slightly less than a, one or more significant figures can be saved 
by rationalizing the expression as the first step in the calculation. Thus, 


Va — = 


a — b 

\/ CL -j- \/ b 
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As in the case of products, the accuracy of a quotient should always be 
investigated by means of the relative error, and all the statements made 
above in regard to products hold for quotients. In particular, if one of 
the numbers (divisor or dividend) is more accurate than the other, the 
more accurate number should be rounded off so as to contain one more 
significant figure than the less accurate one. The result should be given 
to as many significant figures as the less accurate number, and no more. 
The following examples will illustrate the proper methods of investigating 
the accuracy of products and quotients. 

Example 1, Find the product of 349.1 X 863.4 and state how many 
figures of the result are trustworthy. 

Solution. Assuming that each number is correct to four figures but 
no more, we have Aui ^ 0.05, AWo = 0.05. Hence 

-fc’r ^ = 0.000143 + 0.000057 = 0.00020. 

349.1 863.4 

The product of the given numbers is 301413 to six figures. The absolute 
error of this product is 

Ea = 301413 X 0.00020 = 60, possibly. 

The true result therefore lies between 301473 and 301353, and the best 
we can do is to take the mean of these numbers to four significant 
figures, or 

349.1 X 863.4 = 301400 == 3.014 X 10'\ 

Even then there is some uncertainty about the last figure. 

Theorem II of Art. 5 also tells us that the above result is uncertain in 
the fourth figure, but that the error in that figure is less than a unit. 

Example 2. Find the number of correct figures in the quotient 
56.3/ assuming that the numerator is correct to its last figure but 
no farther. 

Solution. Here we take V 5 *= 2.236 so as to make the divisor free 
from error in comparison with the dividend. Then 

0.0009 -, 

and since 66.3/2.236 = 25.2 we have 


Ea < 25.2 X 0.0009 < 0.023. 
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Since this error does not affect the third figure of the quotient, we take 
25.2 as the correct result. 

Note that formula (7. 6) also gives this result. 

We could have seen at a glance, without any investigation, that the error 
of the quotient in tliis e\am])le wouJd be less than 0.025 ; for the denomi- 
nator is free from error and the possible error of 0.05 in the numerator is 
to be divided by 2.230, lliereby making the error of the quotient less than 
half that amount. 


Example S. Find how many figures of the quotient 4.897r/6.7 are trust- 
worthy, assuming that the denominator is true to only two figures. 


Solution. The only af)})reciable error to be considered here is the possible 
0.05 in the denominator. The corresponding relative error is 


/^r; 


0.05 

6.7 


< 0.0075. 


The quotient to three figures is 


4.89X3.14 

6.7 

Hence the possilile absolute error is Ea ^ 2.29 X 0.0075 < 0.02. Since the 
third figure of the quotient may be in error by nearly two units, we are 
not justified in calling the result anything but 2. 3, or 

4.897r ,, 

Formula (7. 6) also gives this same result. 

Example 7y. Find the number of trustworthy figures in the quotient of 
876.3/494.2, assuming that both numbers are approximate and true only 
to the number of digits given. 

Solution. Here the largest relative error is 

0.05 

494:2 

and the quotient is 


Hence by (7. 5) 

A(2 = 2(1.7732) (0.000101) =0.000358. 


Since this error affects tlie fourth decimal jilace but not the third, we take 
the quotient to be 1.773. 
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Note. The greatest and least values of the above quotient are 


876.35 

494.15 


1.7734 and 


876.25 

494.25 


1.7729. 


These values agree to four significant figures and both give 1.773. 
7g), Powers and Roots. Here N has the form 


N = u”^ . 

Hence by (6.4) 

Er ^ m(Au/u). 

For the pi\i power of a number we put m p‘ and have 

Er ^ p(Au/u). 

The relative error of the pth power of a number is thus p times the 
relative error of the given number. 

For the rth root of a number we put m = 1/r and get 


Er^ 


1 

r 


A2/ 

u 


Hence the relative error of the '^th root of an approximate number is only 
1/rth of the relative error of the given number. 

Example. Find the number of trustworthy figures in (0.3862)% as- 
suming that the number in parentheses is correct to its last figure but 
no farther. 


Solution. Here the relative error of the given number is 


0.00005 

0.3862 


< 0.00013. 


The relative error of the result is therefore less than 4 X 0.00013, or 
0.00052. 

The required number to five figures is (0.3862)^ = 0.022246. Hence 
the absolute error of the result is 0.022246 X 0.00052 = 0.000012. Since 
this error affects the fourth significant figure of the result, the best we 
can do is to write 

(0.3862)^ = 0.02225 


and say that the last figure is uncertain by one unit. 

The relative error of the fourth root of 0.3862 is less than ^(0.00013) 
— 0.000032, and since this fourth root is 0.78832 the absolute error of 
the result is about 0.78832 X 0.000032 — 0.000026. Hence the fourth 
root is 0.7883 correct to four figures. 
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7h). Logarithms. Here we have 


Hence 


or 


N = logio u = 0.43429 loge u. 


A2V = 0,43429 (Aw/u), 


AA^<- 


Au 

u 


The absolute error in the common logarithm of a number is thus loss 
than half the relative error of the given number. 

An error in a logarithm may cause a disastrous error in the anti- 
logarithm or corresponding number, for from the first formula for AN 
above we have 


A?^ = 


uAN 

0 . 434 ^ 


= 2.302CyuAN. 


The error in the antilog may thus be many times the error in the loga- 
rithm. For this reason it is of tlie utmost importance that the logarithm 
of a result be as free from error as possible. 

Example 1. Suppose iV = logio = 3.49853 and AiV < 0.000005, so 
that the given logarithm is correct to its last figure. Then u = 3151.6 
and therefore 

A?/ := 2.3 X 3151.6 X 0.000005 = 0.036. 

Since this error does not affect the fifth figure in u, the antilog is correct 
to five figures. 

Example 2. Su])pose N = logio u = 2.96384 and AN = 0.00001. Then 

= 920.11 and 

Aw = 2.3 X 920.11 X 0.00001 =- 0.021. 

This error affects the fifth figure in u and makes it uncertain by two units. 

Inasmuch as the logarithm of most results is obtained by the addition 
of other logarithms, it is evident that sucli a logarithm is likely to be 
in error by a unit in the last figure, due to the addition of rounded 
numbers. Hence the corresponding number may frequently be in error 
by one or two units in its last significant figure when the number of 
significant figures in the antilog is the same as the number of decimals 
in the logarithm. 

Remarks. The reader should bear in mind the fact that the number 
of correct figures in the antilog corresponds to the number of correct 
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decimals in the logarithm. The integral part, or characteristic, of the 
logarithm plays no part in determining the accuracy of the antilog. This 
fact is at once evident from a consideration of the equation 

^u/u = 2.3A]V. 

For inasmuch as the number of correct figures in the antilog u is mea- 
sured by its relative error, and since this latter quantity depends only on 
the absolute error AN and not at all on the characteristic, it is plain that 
the accuracy of the antilog depends only on the number of correct decimals 
in the mantissa. 

It is an easy matter to determine the number of correct figures in any 
antilog when the number of ''orrect decimals in the mantissa is given. 
Suppose, for example, that we are using m-place log tables and that the 
possible error in the logarithm of a result is one unit in the last decimal 
place, as is usually the case. Then aN = 1/1 and we have 

10^ lo X -l.^rxUV"-'” 2X10"'"^ 

Hence by Corollary 4, Art. 5, the antilog u is certainly correct to m — 1 
significant figures. 

The equation — l/(4.34 X shows that if the mantissa is 

in error by two units in its last figure the antilog is still correct to m — 1 
significant figures, for in this case the relative error of the antilog is 

which is less than 1/(2 X lO'^'”^). We are therefore justified in asserting 
that if the mantissa of a logarithm is not in error by more than two units 
in the last decimal f)lace tlie antilog is certainly correct to m — I signifi- 
cant figures. 

8. The Impossibility, in General, of Obtaining a Result More Ac- 
curate than the Data Used. The reader will have observed that in all 
the examples worked in the preceding pages no result has been more 
accurate than the numbers used in obtaining it. This, of course, is what 
we should have expected, but sometimes computers seem to try to get 
more figures in the result than are used in the data. When we apply 
Corollaries 1 and 4 of Art. 5 to the errors of products, quotients, powers, 
roots, logarithms, and antilogarithms, we find that in no case is the result 
true to more figures than are the numbers used in computing it. The 
results for these operations are as follows: 
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(a) Products and Quotients. If ki and are the first significant 
figures of two numbers which are each correct to n significant figures, 
and if neither number is of the form A:( 1.000- • •) X then their 
product or quotient is correct to 

n — 1 significant figures if ki'^2 and k‘> ^ 2, 
n — 2 significant figures if either = 1 or fco = 1. 

(b) Powers and Roots. If k is the first significant figure of a number 
which is correct to n significant figures, and if this number contains more 
than one digit different from zero, tJien its /^th power is correct to 

n — 1 significant figures if p ^ k, 
n — 2 significant figure.s if p ^ 10k; 

and its rth root is correct to 

n significant figures if rk ^ 10, 
n — 1 significant figures if rk < 10. 

(c) Logs and Antilogs. If k is the first significant figure of a number 
which is corr(‘ct to n significant figures, and if tliis number contains 
more tlian one digit different from zero, ihen for the absolute error in 
its common logaritlim we have 

1 

If a logarithm (to tlie base 10) is not in error by more than two units 
in the /nth decimal place, the antilog is certainly correct to rn — 1 signifi- 
cant figures. 

To prove the foregoing results for the accuracy of products and quotients, 
let ^*1 and /r.j represent the first significant figurt's of the given numbers. 
Then by Corollary 1 of Art. 5 the relative errors of the numbers are less 
than X 10"-') and l/( 2K X 10’*"'). respectively; and since the 

relative error of the product or quotient of two numbers may equal the 
sum of their relative eirors, we have 

Relative error of result 


Now if (^/k, + 1 /^'-) ~ 1 we have E\ < 1/(2 X 10 "-'), and the product 
or quotient is certainly correct to n — 1 significant figures, ilut this 
quantity is not greater than 1 if A*i ^ 2 and /»*j § 2. Hence in this case 
the result is correct to n — 1 significant figures. If, however, eitheT* =» 1 


X 10" 




3 X lO”’' 



22 


ACCURACY OF APPROXIMATE CALCULATIONS 


[Chap. I 


or lc 2 — 1, the quantity (I/Ati + l/hz) > 1 and therefore the relative error 
of the result may be greater than 1/(2 X 10”“^). Hence the result may 
not be correct to n — 1 significant figures, but it is certainly correct to 
n — 2 figures. 

To prove the above results for the accuracy of powers and roots let le 
represent the first significant figure of the given number. Then the relative 
error of this number is less than 1/ {2k X 10”"^ ). Hence the relative error 
of its pth power is less than 

P _ P 1 . 

2k X 10"-' k 2X 10"-' 

The result will therefore be correct to w — 1 significant figures if {p/k) ^ 1, 
OT p ^ k, and to n — 2 significant figures if p ^ lOA;. 

The error of the rth root is less than 

1 1 _ 1 1 10 1 ^ 
r 2k X 10"-' rk 2 X 10"-' rk 2 X 10" 

Hence the result will be correct to n significant figures if rk ^ 10 and to 
n — 1 significant figures if rk < 10. 

To prove the result for thi:? ei-'or of the common logarithm we recall 
that AN < ^{Au/u), and since Au/u < 1/(2A; X 10"”') we have 

^ 4ifc X 10’*"* ■ 

The proof for the accuracy of the antilog has already been given at the 
end of Art. 7. 

Since the separate processes of multiplication, division, raising to powers, 
and extraction of roots can not give a result more accurate than the data 
used in obtaining it, no combination of these processes could be expected 
to give a more accurate result except by accident. Hence when only these 
processes are involved in a computation, the result should never be given 
to more significant figures than are contained in the least accurate of the 
factors used. Even th(‘n the last significant figure will usually be uncertain. 
In a computation involving several distinct steps, retain at the end of each 
step one more significant figure than is required in the final result. 

While it is true in general that a computed result is not more accurate 
than the numbers used in obtaining it, an exception must be made in the 
cases of addition and subtraction. When only these processes are involved, 
the result ma} be much more accurate than one of the quantities added or 
subtracted. For example, the sum 3463 V3 3463 + 1.7 — 3464.7 is 
correct to five significant figures (assuming 3463 to be an exact number) 
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even though one of the numbers used in obtaining it is correct to only two 
figures. A similar result would evidently follow in the case of subtraction. 

9. Further Considerations on the Accuracy of a Computed Result. 

In commenting on formulas (7. 1) and (7. 3), it was stated that the 
absolute error of a sum is equal to the algebraic sum of the errors of the 
numbers added, and that the relative error of a product is equal to the 
algebraic sum of the relative errors of the factors. The word “ algebraic ’’ 
deserves empliasis in these cases because errors of measuremnt and errors 
due to rounding are compensating to a very great extent, so that in most 
cases the error in a computed result is not equal to the arithmetical sum 
of the errors of the numbers from which the result was obtained. 

We saw in (7b) that the error in a sum was only a small fraction of 
the arithmetic sum of the separate errors. That the errors of the factors 
in a product are also compensating may be seen by considering the product 
of two exact numbers: 


649.3 X 675.8 = 438,796.94. 


Now suppose we round off these numbers to 649 and 676. Their product 
is tlien 649 X 676 = 438,724. The actual error of this product is 72.94, 
and the relative error is 


72.94 

438,796'.94 


0.000166. 


The relative errors of the factors are 0.3/649.3 = 0.000462 and — 0.2/675.8 
= — 0.000296. The relative error of the product is thus less than the 
relative error of eitlier factor and is actually equal to their algebraic sum. 
The ])roduet in this ease is more accurate than either factor. 

When a long computation is carried out in several steps and the inter- 
mediate results are properly rounded at the end of each step, there is no 
accumulation of rounding errors. If there were, long astronomical com- 
putations, sucli as those of eclipses and the orbits of comets, would be 
worthless. Time and experience have proved the correctness of such 
astronomical computations. In a chain computation the loss of significant 
figures by subtraction is the chief source of error. 

Bad advice is sometimes given in regard to computation. In the addi- 
tion of numliers of umM]ual accuracy, some writers advise that all the 
numbers first be rounded off to the number of decimal places given in 
the least accurate number. When this is done, the computer throws away 
definite information and replaces it with uncertainty. In adding a column 
of several numbers, the uncertainties might largely cancel one another, 
but this would not be the case with only a few numbers. The proper 
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method is to add the more accurate numbers separately and then round 
off their sum to the same decimal place as the least accurate number or 
numbers. In this way, the sum is as accurate as the least accurate of the 
numbers added. 

Similar bad advice is given in the case of multiplication and division. 
When multiplying or dividing numbers of unequal accuracy, some writers 
advise that all numbers first be rounded off to the same number of signifi- 
cant figures as contained in the least accurate factor. To make all factors 
as rough as the roughest one is folly. There is no sense in throwing 
aw^ay perfectly definite information and replacing it wnth a question mark. 
The more accurate factors should be kept with one more significant figure 
than the least accurate factor. Then the result wnll usually be as accurate 
as the least accurate factor. Tiie correct procedure in all ordinary com- 
putations can be stated in 

A Sound and Safe Buie: When computing wiih rounded or a])proximate 
numbers of unequal accuracy, retain from the beginning one more signifi- 
cant figure in the more accurate numbers than are contained in the least 
accurate number. Then round off the result to the same number of 
significant figures as the least accurate number. 

In the case of addition, retain it* the more accurate numbers one more 
decimal digit than is contained in the least accurate number. 

This rule follows from equations (7. 1), (7. 3). and (7. 4). By retaining 
one more digit in the more accurate numbers, w^e reduce to zero the errors 
of those terms and thus reduce the error of the final result. 

In the case of subtraction or of addition of only tivo numbers, round off 
the more accurate number to the same iiumlier of decimal places as the 
less accurate one before subtracting or adding. 

10. Accuracy in the Evaluation of a Formula or Complex Expression. 

The two fundamental jiroblems under this head are the following: 

(a) Given the errors of several independent quantitie.s or a])proximate 
number.s, to find the error of any function of thc'Sf* quantities. 

(b) To find the allowable errors in several independent quantities in 
order to obtain a prescribed degree of accuracy in any function of these 
quantities. 

10a). The Direct Problem. The first of these problems is solved by 
replacing the given approximn! e numbers by the letters a,b,c,- • * or 
Wi, U 2 y U 3 , taking the j)artial derivatives of the function with respect to 
each of these letters, and tlien substituting in formula (fi. 1 ) or (fi. 2 ). 
An exact number, such as 2 , 3, 10 , etc., is not replaced by a letter before 



Abt. 10] 


EVALUATION OF FORMULAS 


25 


taking the derivatives.* We shall now work some examples to show the 
method of procedure. 


Example 1. Find the error in the evaluation of the fraction 
cos 7° lO'/logH) 242.7, assuming that the angle may be in error by 1' and 
that the num])er 242.7 may be in error by a unit in its last figure. 

Solution. Since this is a quotient of two functions, it is better to 
compute the relative error from the formula Er ^ AiZi/Ui + /IU 2 /U 2 and 
tlien find th(‘ absolute error from the relation Ea = NEr. Hence if we 
write 

cos 7 '^10' COSiT 

log,., 242.7 “ logioi/ 

W(‘ have 

A« I = A co.s X = — sin x^x, 


Am,, = A log„, y = 0.4.3429 (Ay/y) . 
1'^. 


sinj; , 0.13429 
r ~ _ Aj- + At/, 


COS X 


y Jog y 


or 


hr - tan .rAx -1- 

- y log y 


Kow taking x = 1° 10', Ax = 1' == 0.000291 radian, y = 242, Ay = 0.1, 
and using a .slide rule for the conijiutation, vvo have 


Er < O.I2t: X 0.000291 + = 0.00011. 

Sinct' X (^os 7*^ lO'^log 242.7 — 0.41599, we have 

Ea = 0.0001 1 X 0.410 == 0.000046, 


or Ea < 0. 00005. 

\alii(‘ of lln* fraction is therefore b<‘twi‘en 0.41604 and 0.41594, 
and take tln^ mean of tlies{‘ numbers to four figures as the best value 
of the fraction, or 

0.4100. 


Example 2. The liyjiotimiise and a side of a right triangle are found 
by measurement to be 75 and 32, respectively. If the possible error in 


* Adopted or Jiecepted viilnes of ])hysi('al, ehemieal, and astronomi'.’al constants are 
to be treat(‘d as (‘\aet ninnbeis, ]mt lesiilLs obtained by using these numbers as 
multipliers or di\isors are not to be relied upon to more significant figures than are 
used in the constants themselves. 
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the hypotenuse is 0.2 and that in the side is 0.1, find the possible error 
in the computed angle A. 

Solution. Lettering the triangle in the usual manner, we have 
sin A = 32/75 =« a/c. 

A = sin'^ (a/c) y 

and 

A.4 = (dA/da)^a (dA/dc)Ac. 

Now 

0^4 /0fl = 1/ 's/'C^ — a^, 

0.4 /0c = — a/(c \^ — a' ). 

Taking the numerical values of c and a in such a manner as to give the 
upper limits for dA/da and dA/dc, and remembering that Aa = 0.1, 
Ac = 0.2, we have 


A.4 < 
or 


XO.l 


32.1 


V(74.8)2 — (32.1)^ 74.8 V(74.8)“" — (32.1)''^ 

AA < 0.0028 radian = 9' 38". 


X 0.2 == 0.00275, 


The possible error in A is therefore less than 9' 38". 

lOh). The Inverse Problem. We now turn our attention to the second 
fundamental problem mentioned at the beginning of this article: that 
of finding the allowable errors in Wj, Wo, * ■ Wn when the function N is 
desired to a given degree of accuracy. This problem is mathematically 
indeterminate, since it would be possible to choose the errors AWi, AUg, etc. 
in a variety of ways so as to make AiV less than any prescribed quantity. 
The problem is solved with the least labor by using what is known as 
the principle of equal effects.* This principle assumes that all the partial 
diilerentials (dN/du^)^Ui, (dN/du 2 )^U 2 , etc., contribute an equal amount 
in making up the total error AiV. Under these conditions all the terms 
in the riglit-hand member of equation (6.1) are equal to one another, 
so that 

^ ^ 0N ^ dN ^ dN ^ 

du du 2 dUn 

Hence 

AN ^ AN ^ AN 

dN ' 

n 5 — — 

UUi OU 2 d'Wn 


See Palmer’s Theory of Measurements, pp. 147-148. 
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Example S. Two sides and the included angle of a trianglar city lot 
are approximately 96 ft., 87 ft., and 36°, respectively. Find the allowable 
errors in these quantities in order that the area of the lot may be deter- 
mined to the nearest square foot. 

Solution, Writing 6 = 96, c =* 87, A = 36°, and denoting the area 
by u, we have 

u = \lc sin A = i(96 X 8*^ sin 36°) = 2455 sq. ft. 

Hence 

du/di = \c sin A, du/dc == ^6 sin A, du/dA = ^tc cos A. 
Substituting these quantities in (6. 2), we find 

Au/u = ^h/b -|- Ac/c AA/tan A. 


Now since the area is to be determined to the nearest square foot we 
must have Au < 0.5; and by the principle of equal effects we must have 


A6 

6 


1 Au ^ 0.5 

3 u 3 X 2455 


Hence A6 < 96 X 0.000068 = 0.0065 ft. 
In like manner , 


1 

14730 


< 0.000068. 


^ = I ^ , or Ac < 87 X 0.000068 = 0.0059 ft. ; 

and 

^ ) or AA < tan 36° X 0.000068 = 0.000049 radian. 

1 Aw tan A 

Hence from a table for converting radians to degrees we find AA = 10". 

It thus appears that in order to attain the desired accuracy in the area 
the sides must be measured to the nearest hundredth of a foot and the 
included angle to the nearest 20" of arc. 

This problem could also be solved by assuming that the possible errors 
in the measured sides might be 0.005 ft. and then computing the per- 
missible error in the measured angle. 

Example Jf. The value of the function 6x“(logioa^ — sin 2y) is required 
correct to two decimal places. If the approximate values of x and y are 
15.2 and 57°, respectively, find the permissible errors in these quantities. 

Solution. Putting 

u = 6a:^(logio X — sin 2y) = 6(15.2)‘(logio 15.2 — sin 114°) 

= 371.9, 
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we have 

du/dx = 12a;(logio x — sin 2y) + 6a; X 0.43429 = 88.54, 
du/dy = — 12a;^ cos 2y = 1127.7. 

Hence 

Au = (du/dx) -f- '■= 88.54Aa; + 1127. 7Ay. 

In order that the required result be correct to two decimal places we 
must have A?/ < 0.005. Then by the principle of equal effects we have 


Aa: 


Aii ^ 0.005 

2 X 88.54 

^ dx 


= 0.000028, 


At/ — < 

dy 

= 0" .45. 


0.005 


2 X 1127.': 


0.0000022 rad. 


Since the permissible error in x is only 0.00003, it will be necessary to 
take X to seven significant figures in order to attain the required degree 
of accuracy in the result. Th^ value of y can then b^ taken to the nearest 
second. 

The reason why the permissible errors in x and y are so small in this 
example is that the factor logioX — sin 2y causes the loss of one significant 
figure by subtraction. 

Remarlc. It is neither necessary nor desirable to investigate the accuracy 
of all proposed computations. But when we are in doubt about the possi- 
bility of attaining a certain degree of accuracy in the final result, we 
should make the necessary investigation. It usually suffices to carry all 
computations to one more figure than is desired in the final result and 
then round off the result to the desired number of figures, if the accuracy 
of the given independent quantities is such as to permit this. 


11. Accuracy in the Determination of Arguments from a Tabulated 
Function. In many problems it is necessary to compute some function 
of an unknown quantity and then determine the quantity from tabulated 
values of the function. Examples of this kind are the determination of 
numbers from a table of logarithms, and angles from trigonometric tables. 
If the computed function happens to be affected with an error, the argu- 
ment determined from this function is necessarily incorrect in some degree. 
The purpose of this article is to investigate the accuracy of the argument 
whose value is required. 
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In tables of single entry are tabulated functions of a single argument. 
Calling X the argument and y the tabulated function, we have 

From this we get the relation 

Ay = f(x)Ax, approximately, 

from which we have 

(11. 1) Ax = Ay/f{x), 

This is the fundamental equation for computing the error in arguments 
taken from a table. Here Ay represents the error in the computed function 
whose values are tabulated, and Ax is the corresponding error in the argu- 
ment. It will be noted that the magnitude of Ax depends upon three 
things : the error in the function, the nature of the function, and the 
magnitude of the argument itself. We shall now apply (11. 1) to several 
functions whose values are tabulated. 

7. Logarithms. 

(а) f{x) == loge X. 
f{x)= l/x. 

(1) Ax = xAy, from (11.1). 

(б) /(i)=logiox. 

f{x) =M/x, where M = 0.43429. 

Ax = xAy/M = 2.3026xAy. 

Hence 

(2) Ax < 2.31xAy. 

S. Trigonometric Functions. 


(a) /(x)=sinx. 

f{x) = cos X. 


(3) 

.*. Ax = Ay/cos X = sec xAy radians. 

or 


(4) 

(Ax)" = 206264.8 sec xAy seconds. 

(&) 

/(x) = tan X. 


f'(x) SfC^ X. 
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( 5 ) 

or 

( 6 ) 


( 7 ) 

or 

(8) 


or 

(9) 

and 

( 10 ) 


. ' . Ax *= cos^ X Ay radians, 

(Ax)" = 206264.8 cos^ xAy seconds. 

(c) f(x) = logic sin X. 

/'(x) =il/ =71/ cot X. 

SIIIX 

Ax = — — = 2.3026 tan xAy radians, 
M cot X 

(Ax)" < 475000 tan xAy seconds. 

(cZ) /(x) = logic tan x. 

sec^ X 3/ 27[/ 


/'(x)=3/ 


tan X sin x cos x sin 2x 


. ^ sin 2xAy ^ ^io • o a 
. . Ax = - — = I.I0I3 sin 2xAt/, 


Ax < 1.16 s»n 2xAy ra'dians; 


(Ax)" < 238000 sin 2xAy seconds. 
Exponential Fmictions. 


( 11 ) 


/(a:) = 
f(x)= e*. 

Ax = Ay/e^. 


Jf. Other Tabulated Functions. By means of the fundamental equation 
(11. 1) we can compute the error in any argument when the derivative of 
the given function is given or can he easily found. Tn Jahnke and 
Emde^s Funktionentafeln, for instance, are tabulated the derivatives of 
logr(x + l)^ the error function the Weierstrass /^-function, 

p(u), and Legendre^s polynomials Pn(x). Hence by means of these tables 
we can determine the arugment and also its error. 

Elliptic integrals are functions of two arguments. The error in each 
of these arguments can not be determined uniquely, but by using formula 
(6.1) and assuming the principle of equal effects we can find definite 
formulas for the errors in the arguments. Thus, denoting an elliptic 
integral by I and the function of the arguments by 1^(^, </>), we have 
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Hence 

A/= {dF/de)^d+ (0F/0^)a</>. 


By assuming that the two terms on the right-hand side are equal, we get 


^e = 
2 


A7 

07 ; 

0(9 



A7 

dF 

d<f> 


Knowing the error A/ of the integral, we can find from these formulas the 
corresponding errors in 9 and <f>. 


Remarks, Comparison of formulas (3) and (5) shows that the error 
made in finding an angle from its tangent is always less than when finding 
it from its sine, because cos^ x is less than sec x. The latter may have any 
value from 1 to oo, whereas the value of the former never exceeds 1. 

Formulas (7) and (9) show still more clearly the advantage of deter- 
mining an angle from its tangent. It is evident from (9) that the error 
in X can rarely exceed the error in y, since sin 2x can not exceed 1, but 
(7) shows that when the angle is determined from its log sine the error 
in X may be many times that in y. 

Let us consider a numerical case. Suppose w^e are to find x from a 
5-place table of log sines. Since all the tabular values are rounded numbers, 
the value of Ay may be as large as 0.000005, due to the inherent errors of 
the table itself. Taking a: ==60*^ and substituting in (7), we get 


^x == 2.3026 X 0.000005 
= 0.00002 radian, about, 
= 4".l. 


The unavoidable error may therefore be as great as 4 seconds if we find 
X from its log sine. 

If, on the other hand, we find x from a table of log tangents we have 
from (9) 

Ax < 1.16 X i X 0.000005 = 0.000005 rad. 

= 1 ". 


The error is thus only one-fourth as great as in the preceding case. 

The foregoing formulas simply substantiate what has long been known 
by computers: that an angle can be determined more accurately from its 
tangent or cotangent than from its sine or cosine. 

Note, The problem of determining the maximum possible error in a 
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result found by means of tables is rather involved. The reader will find 
a masterly treatment of this matter in J. Liiroth’s Vorlesungen uher 
numerisches Rechen, Leipzig, 1900. 

However, the problem is of little practical importance, because the errors 
in such a computation rarely if ever combine so as to produce their 
maximum aggregate effect. They neutralize one another as the calcu- 
lation proceeds. 

12. The Accuracy of Series Approximations. It is frequently easier 
to find the numerical value of a function by expanding it into a power series 
and evaluating the first few terms ihan by any other method. In fact, this 
is sometimes the only possible method of computing it. The general 
method for expanding functions into power series is by means of Taylor’s 
formula. The two standard forms of this formula are the following: 

( 1 ) fix) =/(a) + ix-a)ria) + + ■ ■ '+ (a) 

+ ^~-^f^’'^\a + eix- - a)], 0<e<h 

( 2 ) fix + h)=fix)+hf{x) + ^!^jrix)+-- 

n . 

On putting a = 0 in (1) we get Maclaurins formula: 

(3) fix) =/(0) + xfiO) + ^^/"(O) + ■ • • + 

+ ^P”>iex), o<o<i. 

The last term in each of these three formulas is th(‘ remainder after 
n terms. This remainder term is the quant jiy in wliicli w^e shall be 
interested in this article. The forms of* the remainder given above are 
not the only ones, however. Another useful form will be given below. 

12a). The Remainder Terms in Taylor’s and Maclaurins Series. De- 
noting by Rn{x) the remainder after n terms in the Taylor and Maclaiirin 
expansions, we have the following useful forms : 

1. For Taylor’s formula (1) : 

R„ix)=. y)" /(n)[a+g(a;_a)], 0 <<?<!. 

71 1 


(a) 
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(6) ie„(x) = (^x-t)t«-^dt. 

2. For Taylor^s formula (2) : 

(a) i?„(a;) = + 0 < ff < 1. 

Tl I 

(b) 

3. For Maclaurin’s formula: 

(a) R„(x) ^ 0<(9<1. 

71 I 

(b) R„(X) - 

It will be observed that the second form (the integral form) is perfectly 
definite and contains no uncertain factor $. In using either form, however, 
it is necessary first to find the nth derivative of f(x). 

Since the integral form of Bn(x) is not usually given in the textbooks 
on calculus, we shall show how to apply it to an example. 

Example. Find the remainder after n terms in the expansion of 
loge {x + h). 

Solution. Here 

j{x) =log,a-, 
f (x) =l/x, 
r{x) =_(l/x=), 

r(x) = 2/x’, 

/■v(x) =- (6/x‘), 


/(n) (I) 




/. R^{x) = (- 1 )-- 


(n-1)! n 

(n — 1) ! Jo 


1 . 

(x -j- h — t)^ 




Now since t varies from 0 to h, the greatest value of Rn{x) is obtained 
by putting t in the integrand. We then have, omitting the factor 
( — 1)”“^, which is never greater than 1, 



34 


ACCURACY OF APPROXIMATE CALCULATIONS 


[Chap. I 


Rn 








n 



Suj)pose x = I, 7/ =0.01. Then A/a; = 0.01. If, therefore^ we wish to 
know how many terms in the expansion of loge 1.01 are necessary in order to 
get a result correct to seven decimal places we take Rn ^ 0.00000005. 


(1/w) (0.01)” = 0.00000005. 

It is evident by inspection that n = 4 will give a remainder much smaller 
than the allowable error. Hence we take four ierms of the expansion of 

(a; + h). 

The reader can easily verify that the first form of remainder gives the 
same result as that just found. 

12h). Alternating Series. An alternating series is an infinite series in 
which the terms are alternafely positive and negative. Such a series is 
convergent if (a) each term is numerically less limn the preceding and 
(b) the limit of the nth term is zero when n becomes infinite. 

Alternating senes are of frequent occurrence in af)plied mathematics 
and are the most satisfactory for purposes of computation, because it is 
always an easy matter to determine the error of a com})uted result. The 
rule for determining the erro” is rimply this: 

In a convergent alt ernatvng series the error conimiii ed in stopping with 
any term is always less than the first term neglected. 

Thus, since 


loge (1 -\-x) =x — 0*72 + 0:^/3 — j-yi + a:V5 — • 

we have 


log. (1.01) =0.01 — 


( 0 . 01 )--^ , ( 0 . 0 !)^ 

1 ^ 


y 


where R < | (0.01) 74 | = 0.0000000025. 

We therefore get a result true to eight decimal places by taking only 
three terms of the expansion. 

12c). Some Important Series and Their Remainder Terms. Below are 
given some of the most useful series and their remainder terms, alternating 
series not being included because their remainder terms can be computed 
by the rule given above. 

1. The Binomial Series. 




m{m — 1) ^ , 'rn{m — 1)(^ — g 


2! 




3! 




, m(m — l){m — 2) - {m — n+2) 
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x^{i + 6x)”'-^y o<e<i 
s" I if a: > 0. 


m{m — 1) {m — 2) ' • 

•(m — n-fl) a:” 

n ! 

(1 + a:)"-” 


Tl I 

in all cases. 

^ in{m — l)(m — 2)* • • (m — n 4- 1) .. 

(o) Rn< — ^ iix>0. 

n\ 

(c) R < — — — ^ + 1) g” 

^ ^ ^ ^ _|_ 3.)n-m 

if a; < 0 and n '> m, 

{d) /2n < I x"* I (1 + x)”^ if — 1 < m < 0. 

If m is a fraction, positive or negative, or a negative integer, the binomial 
expansion is valid only when | a; | < 1. Also, except when m is a positive 
Integer, a binomial such as {a must be written in the form 

^ if a > &, or 6"" if 6 > a, 

before expanding it. 

2. Exponential Series. 

If in (a) we put a: = 1 we get the following series for computing e: 

/ ^ ,,,,1,1,1, , 1 , e* 

(c) e = l + l + - + ^ + ^+ - • •+ ■(„_!) ! +„! • 


n ! 

But since e < 3 and ^ g 1, it is plain that 


A more definite formula for Rn can be found as follows: 
Writing more than n terms of the series (c), we have 

' ■+ (n-Di] 

■ 1 I 1- 1 1 +. . . 

n! (n + 1) 1 (n + 2) ! 
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where the remainder after n terms is 


R. 


.-L + I 

n! ^ (n + 1) ! 


u 


1 + 


(n + 3)! 
1 


+ 


) 


n+ 1 ^(n + l)(n + 2)‘^ 

The quantity in parenthesis on the right is clearly less than the sum of 
the geometric series 


1 + + 1/n^ + l/n« + 


the sum of which is 


n 


Hence 

(e) 


1 1/71 ft 1 


n— 1 ’ 


(n — 1) (n — 1) ! 


By means of this formula (e) we can find the requisite number of 
terms in the expansion (c) to give the value of e correct to any desired 
number of decimal places. Thus, if we wished to find e correct to ten 
decimal places by means of the series (c) we would find n from the equa- 
tion l/(n — l)(n — 1) ! = 0.00000000005. With the aid of a table of 
the reciprocals of the factorials we find that n — 1 =* 13, or n — 14. We 
should therefore take 14 terms of the series (c). We find in like manner 
that in order to compute e correct to 100 decimal places we should take 
71 terms of the series (c). 


3. Logarithmic Series, 
(a) loge (m 4- 1) = logo m 

+ • • ■ 


- + 
L2m + 1 ^ 


3(2m + 1)» ' 5(2m + !)» 


(2n— l)(2m + 1)“" 


+ 


To find an upper limit for Rn we have 


Rn 


[ 


(2re+ l)(2m + I)*"*" (2n + 3) (2m + 

1 


+ 


(2n + 5)(2m4-l)*»« 


+ • 


■] 


Each term of the series in brackets, after the first, is less than the corre- 
sponding term of the series 
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(2n+l)(27w 4-l)“"** + (2n + 1) (2m + !)*"♦» 
, 1 


or 


(2n+l) (2m + !)*"*» 
1 


+ ■ 


(2n+l)(2m + l)=“'‘"C^+ (2m + l)» + (2m+l)‘ + ' ' ‘ 1’ 

1 


which is a geometric series with ratio 


1 — 


or 


(2m -f 1)" 
4m (m + 1) 


(2m + 1) = 
Hence 


and 


(2m -h 1)2 

< a ( ^ ) (2m + 1) 

\(2n+l)(2m + l)"“’V4m(m + ] 


Therefore 

( 6 ) 


i) 

1 1 
2 m(m + l)(2n+l) (2m + !)*»- 




2 m(m + l)(2n + 1) (2m + I)"”-* 


Example 1. To compute In 2 * by taking three terms of (o) we have, 
since m = 1, n == 3, 


In 2 




and by (6), 


/^n<- 


1 


2 2(7)(3)= 


= 0.000147, 


which affects the fourth decimal place. Since the true value of In 2 to 
eight decimal places is 0.69314718, the error in the value found above is 
0.000143, which is less than 0.000147. 

Example 2. To find In 5 correct to ten decimal places we have m — 4, 
(1/2) • (1/10^^^). Hence, by (h), 

1 1 _ 1 _ 

2 4 X 5(271 + 1) (9)2'*^ 2 10^°’ 

or 

(2n + l)(9)2"-^ = 5 X 10® = 500,000,000. 


We find by trial that n is about 4. 1, and that for n = 5 the logarithm will 
be correct to 11 decimal places. 

* Frequently in this book we shall write In for log.. 
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12d). Some nth Derivatives. In computing the remainder term in a 
series it is necessary to have the nth derivative of the given function. 
To facilitate the calculation of Rn we therefore give below a list of nth 
derivatives of some simple functions. The symbol D denotes differentia- 
tion with respect to x, or D = d/dx. 


(а) 

(б) 
(0 
{d) 

(e) 

(f) 


D" 


D^a^” = a*(loge a)". 

D'^ sin X = sin [a: -|- n (7r/2 ) ] . 

D^ cos X = COs[x n('7r /2)]- 

7) ( ^ V (— 

” \ a + fex/ (u + 

( 1 \ _ (— i)”i - a r.- ■ ■ (2n-i) 

Vvr ^/ 


D” logr(a hx) 


(— l)”{n— l)\h '' 
{a -)- bx)” 


(9) ^"(^) ^ ^ - (1 + i + 4 + • • • + lAO]- 

(h) D”log, (1 = (— l)"-'2(n— l)!cos j^nsitr' (vv^)] 

(1 + 

(t) D” tail-* X = ^ r ” ’ (~ 7 )~l • 


( — 1 )"n ! 


(j\ nn t = • - 


T Sin 






-f (a + ^a)sin(ri + 1)^], 


where 


p == V — a)^ + 6^ 


^ = tan"^ — ^ — 

X — a 


For an extensive investigation of nth derivatives the reader is referred 
to Steffensen’fl Interpolation, pp. 231-241. 

13 . Accuracy of the Solution of Simultaneous Linear Equations. 

In some fields of applied mathematics one encounters systems of linear 
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equations in which the coefficients and constant terms are subject to small 
errors. Such errors may be due to uncertainties in experimental data or 
to rounding off. The solutions of such systems of equations will therefore 
be inaccurate in some degree, and it is very desirable to have a method 
of estimating the inherent errors of such solutions. 

Consider the simple system 

/j) ja,x+6.y = c, 

'■ ’ la..x + b-zy = Ci . 

If the exact values of the constants are Ui + Afli, hi + Ah i, etc., and the 
corresponding true values of x and y are x Ax and y + Ay, then the 
system (1) becomes 

(2\ ) ( 2 : 4- As;) + ( J, + Aft, ) (y 4- Ay) = c, + Ac, 

^ + ^(^2) + (^2 + Afcs) {y + %) = C2 + AC2 . 


Multiplying out, drop})ing the terms involving the products of two errors 
(such as AayAx etc., since they are negligible t, and making use of (1), 
we get 

(a, Ax 4 - xAai -f biAy + yAhi = Ac^ 

^ )a2Ax 4 xAa2 4 ^2Ay 4 = ^^ 2 . 

Now since Aa,, Ahu etc. are supposed to be known, and x and y can be 
found from (1), we have 


^a^Ax 4 h^Ay = ACi ~-{xAai 4 yAb,), 

^(72Ax — j-“ h-jAy = ACo — ^xAq>2 4* 

Since tbe right-hand members of these equations are known, one can 
readily find A.r and Ay from (4). 

Tt is to be noted that the coefficients of Aa* and Ay in (4) are the same 
as those of x and y in (1). Uence if the equations are solved by deter- 
minants (Cramer’s Kule), the determinant 


jflfi 


\a2 


bi\ 
60 1 


serves for both sets of equations. 

Since the values of x and y in (1) are 


Cyb 2 — c>h] 
dibn — ci2b\ ’ 


Ciod'i ~~~ 

dlbn ^2^1 


it is evident that the magnitudes of x and y vary directly with the magni- 
tudes of the c’s, a fact which is obvious if we put Ci « Cg =- k. Then 
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Ic i^l)2 ^ ) 

(lll)2 Q/’tbi 0Lib2 “ 0/2^1 

Hence in order to get the upper limits of the errors Ax and Ay, we should 
make the right-hand members of (4) as large as possible. This is done 
by taking the sum of the absolute values of the quantities in the right- 
hand members of (4). 

It is to be further noted that equations (3) are merely the differentials 
of (1) and can therefore be written down at once by differentiating the 
given equations. 

The upper limits of the inherent errors in the solution of a system of 
simultaneous linear equations can now be found by the following procedure : 

1. Solve the given system for the unknowns in the usual manner. 

2. Take the differentials of the equations of the given system and write 
the results in the form (4). 

3. Substitute in the differential system found in step 2 the assumed 
values of the errors Aaj, etc. and the values of x and y found in 
step 1. 

4. Taking the arithmetic sum (sura of the absolute values) of the 
quantities in the right-hand members of the equations found in 
step 3, solve the system for Ax, Ay, etc. 

Example /. Solve the system 

3.21x — 4.36y— 5.73 
2.13x + 8.63y — 12.65, 


assuming that all the numerical values are rounded numbers and correct 
to two decimal places. 


Solution, Solving these equations by determinants, we have 



5.73 

12.65 

— 4.36 

8.63 

_ 49.4499 + 55.1540 

2/ 

3.21 

— 4.36 

27.7023 + 9.2868 


2.13 

8.63 



3.21 

5.73 



2.13 

12.65 

_ 40.6065 — 12.2049 

y »» 

36.9891 

36.9891 


Before proceeding further we substitute these values of x and y in the 
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given equations to see whether they satisfy those equations. It will be 
found that they do. 

Since the given equations are correct to two decimal places, the errors 
Aui, A&i, etc. are not greater than 0.005. Hence the equations for finding 
the possible errors in x and y are 


3.2lAa; — 4.36Ai/ = 0.005 + (2.828 + 0.7^8) (0.005) 

= 0.005(1 + 2.828 + 0.768) == 0.0230, 
2.13Aa: + 8.63Ay = 0.005 + (2.828 + 0.768) (0.005) = 0.0230. 
Then 


Ax «= 

0.0230 — 

0.0230 

4.36 1 
8.63 

0.0230 

1 

— 4.36 


37.0 

~ 3r.o 1 

1 

8.63 


3.21 

2.13 

0.0230 1 

0.0230 

^ 0.0230 

j 3.21 

1 

1 

Q'V Ci 


j 2.13 

1 


37.0 


= 0.00067. 


These errors affect the second decimal in x and the third decimal in y. 
Hence we may take :r *= 2.83 and 0.768 with the understanding that 
the la^st digit in each is slightly uncertain. 

If we change the sign of the coefficient of y in the first of the given 
equations and then solve the set, we find Aar = 0.0033 and Ay == 0.00084. 

Example 2. Solve ih^ system 

fl.22x — 1.32y + 3.96^ = 2.12 
J 2.12a; — 3.52y + 1.622 = — 1.26 
[4.23a: — 1.21y + 1.092 = 3.22, 

all numbers being rounded and cxirrect to the number of digits given. 
Solution. Here 


1.22 

— 1.32 

3.96 

2.12 

— 3.52 

1.62 

4.23 

— 1.21 

1.09 


64.404516 — 23.884520 
40.520, 


55.077264 — 16.832552 . 

2* __ _____ 0.94oo, 


40.520 

62.666064 — 12.938452 
40.520 


1.227, 


47.612136 — 21.126204 
40.520 


0.65365. 
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The solutions are written as above to indicate that there was no loss of 
significant figures by subtraction. 

It will be found that the above values satisfy the given equations, except 
for 0.001 in the second equation. 

Since the possible errors in the coefficients and constant terms do not 
exceed 0.005, the error equations are 


Then 


Ax =« 


1.22AX — 1.32At/ + 3.96AZ = 0.005 

4- (0.944 + 1.227 + 0.654) (0.005) =« 
‘ 2.12AX — 3.52Ay + 1.62Aa = 0.01412 
4.23AZ — 1.21AI/ + 1.09A3 = 0.01412. 


0.01412 

0.01412 

— 1.32 

— 3.52 

3.96 

1.62 


1 

— 1.32 

3.96 

0.01412 

1 

— 1.21 

1.09 

_ 0.01412 

1 

— 3.52 

1.62 


40.52 


40.52 

1 

— 1.21 

1.09 


0.01412 


= 0.0023. 


Similarly, Ay = 0.0015, A 2 = 0.0023. Hence x, y, and z are true to 2 
decimal places and we take them to be 


x = 0.94, y = 1.23, 2 = 0.65. 


Note. The values found for Ax, Ay, and Az are the maximum possible 
errors for x, y, and z. The true errors in these quantities may be, and 
probably are, mueii smaller than these maximum errors. 

Example S. Solve the system 

^47.11x + 13.72y = 40.44 
^ 13.72x4 4y =11.78, 

the coefficient of y in the second equation being an exact number and all 
the other numbers being rounded but correct to the number of digits given. 

Solution. Solving by determinants we have 


40.44 

13.72 

11.78 

4 

47.11 

13.72 

13.72 

4 

47.11 

40.44 

13.72 

11.78 


0.2016 


161.76 — 161. 6216 0.1384 
188.44— 188.2384 0.2016 


554.9588 — 554.8368 
0.2016 


0 ^ 1 _^ 

0.2016 


0.5903. 
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Note that the first three significant figures were lost by subtraction in 
this example. Nevertheless, the values found satisfy the given equations. 

Note also that no numbers were rounded in the above computation. 
In the solution of systems of simultaneous equations no numbers should 
be rounded or shortened in any way until the final results are reached, 
otherwise errors of computation will be introduced and the results found 
will not satisfy the given equations. 

For the computation of the errors in x and y, we have 

Afli = A&i = Aci = A^To = ACv = 0.005, and A &2 = 0. 

Hence the error equations are 

Ul.n^x + 13.72Ay = 0.005 +(0.6865 + 0.5903) (0.005) = 0.01138 
|l3.72Aa; + 4Ay = 0.005 + 0.6865 X 0.005 == 0.00843. 

Therefore 

0.01138 13.72 

_ 0.00843 4 

0 . 2 ^ 


0.04552 — 0.11 :>66 




= — 0.35, 


Ay = 


47.11 0.01138 

13.72 0.00843 

0^6 16 


0.3971 —0.1561 
0.2016 


1 . 20 . 


The possible errors in x and y are thus larger than the quantities them- 
selves. This might mean that the values found for x and y arc worthless, 
but it is known from additional information that the value of x is roughly 
corr(‘ct. The value of y is practically worthless.* 

Geometrical considerations help to explain some of the trouble in this 
example A glance at the given equations sliows that the graphs of those 
equations are almost parallel straight lines. Hence slight changes in 
their positions, due to altering their coefficients, will cause their point of 
intersection to change greatly. The only way to get more dependable 
results is to have coefficients of greater accuracy". 

The real source of the inherent errors in the solution of systems of linear 
equations is the loss of leading significant figures by subtraction. Any 
iiiethod t of solving the equations will necessitate the sulitraction of num- 
bers of the saim‘ order of magnitude, and when two such numbers are nearly 
equal there will be a loss of leading digits. This loss produces an inherent 
error in the solution. 

• This example is a slight variation of Example 3, p. 456. 
t Except iteration. See Art. 104. 
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Such a loss of leading digits can be seen at a glance if the equations are 
solved by determinants and the determinants are expanded by the method 
of minors. In systems involving several equations, however, such a method 
of solution is impracticable and therefore the loss of leading digits can 
not be detected. Hence it is necessary to have a method of computing the 
maximum inherent errors in the solution. 

Example 3 serves to bring out the fact that the solution of a system of 
linear equations may be much less reliable than the coefficients and con- 
stant terms. Hence in solving a system of linear equations the solution 
should be carried through without dropping any seemingly surplus digits 
until the end is reached. Then the results found should be substituted 
in the given equations to see if they satisfy those equations. And, finally, 
the upper limits of the errors of the solutions should be computed. The 
final results should not be given to more digits than the errors justify. 

13a. Errors in Determinants. In Examjile 3 of the preceding article 
we have seen that when the elements in a determinant are inexact numbers, 
due to rounding or otherwise, tlie value of the determinant may be seriously 
affected by the loss of the ni<‘'^t important significant figures in the expan- 
sion or evaluation proce.s.s. The amount of such losses cannot be deter- 
mined in advance. We can, howe\er, (leterniine the upjier limit of the 
error in a determinant who.M* elenienth are suiiject to given possible errors. 
For jiurposes of illinstiatioii wv coii.'>id(M* a detin-minant of the third order. 

Let 

j .1*1 Xj x.\ 

(1) e=,//, //_. 

,‘i ! 


Now if the elements are .suliject to possible errors of unknown signs but of 
magnitudes AjTi, Ayi, etc., which are small in comparison with x,, y^, etc., 
then the value of D will be subject to the possible error AZ> such that 




D + ^D = 


Xj — I*- AX|^ 
Ui + 

2, -t- A2, 


St — j- A./'j 

!h + 

z, -f A-z^ 


J’o Ai*3 

y.5 + 

Z.T -p AZn 


By the addition theorem of (Jeterniinants the right member of (2) can 
be expressed as the sum of eight determinants, the first of which is the 
original determinant 1). Each of three of the remaining determinants 
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containfi one column of error elements, each of three of the others contains 
two columns of error elements, and the remaining determinant has three 
columns of error elements. All determinants containing more than one 
column of error elements will be neglected, because, when expanded, the 
resulting terms will all contain second and third powers of the errors and 
will therefore be negligible in comparison with terms containing only the 
first powers of the errors. The value of AZ> is thus the sum of three deter- 
minants each containing a single column of error elements. 

But those determinants are only the differential of I), and we therefore 
have 




dxi 


•Ta 


Xi 

dx. 

X's 


Xx 

X, 

dsj, 

(3) 

dD = 

dy, 

y-j^ 

y^ 

+ 

Vi 

dy2 

yd 

+ 

yi 

Vd 

dyi 



dz j 


Z 3 



dz. 

2a 


2l 

2a 

dz. 


or 


(4) dl)= {y.z,, — y^z,)(ljr , — (x>z^ — x.z,)dy^ + {xaj^ — x^,y.)dz^ 

— — y^z,)dx2 -i- (J-,^3 — ^3^1 — — X:,yi)dz> 

+ {yi2‘2 — y>Zi)dx.— (x^z. — x,Zi)dyj-f- (xry, — x.y,)dz^,. 

The maximum possible error would occur when the signs of the elements 
and the signs of the error> were such that all the eighteen terms in the 
right member of (4) were of the same sign — a very remote possibility. 

Equation (4) shows that the error in a determinant composed of inexact 
elements may be anything from zero up to a number of considerable mag- 
nitude. It must be borne in mind, however, that the terms in (4) will 
largely cancel one another so tliat, in general, dD will not be large. 

14. A Final Remark. The present chapter may appropriately close 
with the following lines from Alexander Pope: 

A little learning is a dangerous thing; 

Drink deep, or taste not the Pierian spring: 

There shallow draughts intoxicate the brain, 

And drinking largely sobers us again. 

Pope was probably not thinking of apiiroximate calculation when he 
wrote those lines, but no better advice could be given with respect to that 
subject. A smatter of knowledge of approximate calculation is worse than 
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no knowledge at all. Fragmentary knowledge may lead to rough results 
that cannot be trusted. The author has seen students and teachers obtain 
far worse results from applying hazy ideas of the subject than if they had 
never heard of it. Their faulty work was due mostly to drastic rounding 
of numbers (at the beginning of a computation or at intermediate steps) 
or to dropping non-negligible terms in a series. 

The essence of this chapter cannot be given in one or two recitations, 
nor in two or three. If the teacher has only two or three recitations to 
devote to it, he had better leave it out entirely. 

EXERCISES I 

1 . Round off the following numbers correctly to four significant figures: 

63.8543, 93487, 0.0063945, 83615, 363042, 0.090038, 53908. 

2 . A carpenter measures a 10-foot beam to the nearest eighth of an 
inch, and a machinist measures a ^-inch bolt to the nearest thousandth 
of an inch.* Which measurement is the more accurate? 

3. The following numb-rs r>re all approximate and are correct as far 
as their last digits only. Find their sum. 

136.421, 28.3, 321, 68.243, 17.482. 

4 . Find the sum of the following approximate numbers, each being 
correct only lo the number of significant figures given : 

0.15625, 86.43, 191.6, 432.0 X 10, 930.42. 

5. The numbers 48.392 and 6852.4 are both approximate and true only 
to their last digits. Find their difference and state how many figures in 
the result are trustwortliy. 

6. Find the value of VlO — tt correct to five significant figures. 

7. The theoretical horsepower available in a stream is given by the 
formula 

whQ 
o50 ’ 

where h = head in feet, Q = discharge in cubic feet per second, and w 
weight of a cubic foot of water. The weight of fresh water varies from 
62.3 to 62.5 lbs. per cubic foot, depending upon its temperature and purity. 

* When a measurement is recorded to the nearest unit, the absolute error of the 
measurement is not more than half a unit. 
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If the measured values of Q and h are Q = 463 cu. ft./sec. and 
h — 16.42 ft., find the H. P. of the stream and indicate how many figures 
of the result are reliable. 

8 . The velocity of water flowing in long pipes is given by the formula 

/ 2ghd 

V = \ ft./sec., 

where g = acceleration of gravity = 32.2 ft./sec.^ 

^ = head in feet, 
d = diameter of pipe in feet, 

I — length of pipe in feet, 
f = coetficient of pipe friction. 

In this problem the factor f is the most uncertain. It varies from 0.01 
to 0.05 and is usually somewhere between 0.02 and 0.03. Assuming that 
/ is within tlio limits 0.02 and 0.03 and taking 

g = 32.2, 
h = 112 feet, 
d = ^ foot, 

Z = 1865 feet, 

find V and indicate its reliability. 

9 . The velocity of water in a short pipe is given by the formula 


V 


4 


2gh 

YJ'+fi/d 


where g^ h, /, Z, and d have the same meanings as in the preceding 
example. Taking I = 75 feet and the other data the same as in Ex. 8, 
find V and indicate its reliability. 

10. The acceleration of gravity at any point on the earth’s surface is 
given by the formula 

g = 32.1721 — 0.08211 cos 2L — 0.000003F, 


where B = altitude in feet above sea level, and L = latitude of the place. 
It thus appears that the value of g is not 32, nor 32.2, nor even 32.17. 

Compute the kinetic energy of a lOO-pound projectile moving with a 
velocity of 2000 feet per second by taking g equal to 32, 32.2, and 32.17 
in succession and note the extent to which the results disagree after the 
first two or three figures. 


11 . How accurately should the length and time of vibration of a seconds 
piendulum be measured in order that the computed value of g be correct 
to 0.05 per cent? 
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12. If in the formula 




the percentage error in R is not to exceed 0.3 per cent, find the allowable 
percentage errors in r and h when r = 48 mm. and h = 56 mm. 

13. When the index of refraction of a liquid is determined by means 
of a refractomcter, the index n is given by the formula 


n= V — sin* 0 . 


li N = 1.62200 with an uncertainty of 0.00004 and 6 = 38° approximately, 
find AO in order that n may be reliable to 0.02 per cent. 

14. The area of the cross section of a rod is desired to 0.2 per cent. 

How accurately should the diameter be measured? 

15. The approximate latitude of a place can be easily found by 
measuring the altitude h of Polaris at a known time i and using the 
formula 

L = h — p cos ty 

where p = polar distance = 90'- — declination. 

Treating p as a constant and equal to 1°07'30", and taking h ^41°25', 
t = 0°38'42", find the error in L due to errors of 1' in h and 5'^ in t. 

16. In the preceding example find the allowable errors in h and t in 

order that the error in L shall not exceed 1', using the same values of p, 
t, and h as before. • 

17. The distance between any two points Pj and Pg on the earth’s 
surface is given by the formula 

cos D = sin Li sin L 2 -j- cos Lj cos Ln cos(Ai — A 2 ), 

where Pi, L 2 and A,, A-,' denote the respective latitudes and longitudes of 
the two jdaces. Find the allowalile errors in Pj, L,, Ai, A 2 in order that 
the error in D shall not exceed 1' (a geographical mile), taking 

P, -=36°10'A^ P2 = r)8°43'A, A, 82°ir>' W, A 2 = 125°42' W. 


18. The fundamental equations of practical astronomy are: 

(1) sin /i = sin 5 sin P cos S cos P cos t, 

(2) cos h cos A = — sin 8 cos P cos 8 sin P cos t, 

(3) cos h sin A = cos 8 sin 

where 8 denotes declination, t hour angle, h altitude, and A azimuth of 
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a celestial body and L denotes the latitude of a place on the earth. The 
declination h is always accurately known and may therefore be considered 
free from error. 

Differentiating (1) by considering 8 constant and h, L, t as variables, 
we have 

cos h dh — sin 8 cos L dL — cos 8 sin L cos t dL — cos 8 cos L sin t dt. 

Replacing cos 8 sin L cos t and cos 8 sin t on the right by their values from 
(2) and (3), respectively, we get 

dh = — (cos A dL sin A cos L dt). 

Solving for dL, 

(4) dL = — (sec A dh tan A cos L dt). 

This equation shows that the numerical value of dL is least when A is 
near 0° or 180°, that is, when the body is near the meridian. If A should 
be near 90°, that is, if the body should be near the prime vertical, the 
error in L might be enormous. Hence when determining latitude the 
observed body should be as near the meridian as possible. 

Using equation (4), compute dL when dh^l\ d^ = 10% L = 40°, 
A — 10°, and A = 80°. 

19 . Using the formula dL = — (sec A dh tan A cos Ldt), find the 
allowable errors in t and h in order that the error in L may not exceed 1' 
when /y*«40° and (a) .4 = 10° and (b) ^==75°. 

20 . From the relation 

cos hdh « (sin 8 cos L — cos 8 sin L cos t)dL — cos 8 cos L sin tdt 
we find by means of (2) and (3) of Ex. 18 

dh cos AdL 

d I = ' , . j 

sin A cos L 

This equation shows that dt is least numerically when A is near 90°, that 
is, when the observed body is near the prime vertical; it also shows that 
when the body is on or near the prime vertical an error in the assumed 
latitude has practically no effect on the error in t. 

Compute dt when dh «= 1', dL == 5', L = 40°, ^4 = 10°, and ^ = 80°. 

21 . Using tlie formula for dt in the preceding example, find the allow- 
able errors in L and h in order that dt may not exceed 3% taking L = 40°, 
il — 10°, and A — 80°. 

22 . Using the formula of Ex. 20, take dt = 3% dh -= 1', and find dL 
for A ^ 10° and A — 80°. 
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23. In the oquation 

X = a sin {ki a) 

suppose ‘a, k and a are subject to the errors Aa, ^k, Aa, respectively. 
Compute Ax and see whieli of the errors Aa, AA% Aa is tlie most potent 
in causing an error in x. 

24. Find the value of 

0 fl 

J = i (sin x/x) r/x 

./ o 

correct to five d(‘cimal places. 

25. Compute the value of the integral 

^v/2. 

I — 0.1 f)'? sin- <^r/</> 

0 

correct to five significant figures hy first expanding the integrand by the 
binomial tluHinmi and tlien integrating the result term hy term. 

26. Solve the following system of equations and determine the possible 
errors in your solutions: 

3.ir>x — l.OOy -[- 3-952= 12.95 

2.13X + h.V^y — 2.892 -= — 8.61 
5.92x + 3.05^ + 2.1 52 = 6.88. 

27. Solve the following system ami determine the possible errors in 
your solutions: 

2.22x — 3.96y + 3.112 + 3.86u = — 3.08 
3.09X — 1.97y + 6.232 + 5.17w = — 1.13 
4.91x 4- 7.83y + 9.152 + 2.74i/ = 8.69 

1 .34x _ o.HOy — 2.892 — 7.23?^ = 2.15. 

28. In the formula 

cos k == ^ hs)coB i{hi -[- / 13 ) 

sin i{tj — 'f 3 ) cos hz 

k denotes an angle; h„ h.j, //.„ f,, are all po.sitive; — /ij and (<, — i^) 
are small quantities; and {hi — h^) is small in comparison with hz. Find 
the maximum error in k due to errors in t and h, assuming that 

I dhi I — I dhz I I dh^ | and \ dti \ dts\, 

.29. Using the result found in Ex. 28, find the maximum value 
of dk when c/f « 0*.05, = 0'.05, =-= 40°, == 40° 15', ^3 — 40° 30', 

tx — fs — — 4r 
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INTERPOLATION 

DIFFERENCES. NEWTON^S FORMULAS OF INTERPOLATION 

15. Introduction. Interpolation has been defined as the art of reading 
between the lines of a table, and in elementary mathematics tlie term usually 
denotes the j)rocess of computing intermediate values of a function from 
a set of given or tabular values of that function. The general problem 
of interpolation, however, is much larger than this. In higher mathematics 
we frequently have to deal with functions whose analytical form is either 
totally unknown or else is of such a nature (complicated or otherwise) that 
the function can not easily be subjected to such operations as may be^ 
required. In either case it is desirable to replace the given function by 
another w’hich can be more readily handled. This operation of replacing 
or representing a given function by a simpler one constitutes interpolation 
in the broad sense of the term.* 

The general problem of interpolation consists, then, in representing a 
function, known or unknown, in a form chosen in advance, with the aid 
of given values which this function takes for definite values of the inde- 
pendent variable. 

Thus, let y = f{jr) he a function given by the values yo,y\,y 2 ,' * * yn 
which it takes for the values Jq. ' ' ‘ 3*n of the mdepondent variable x, 

and let denote an arbitrary simpler function so constructed that it 

takes the same values as f{x) for the values Then if 

f{x) is replaced by (t>{x) over a given interval, the process constitutes 
interpolation, and the function <f>{x) is a formula of interpolation. 

The function can take a variety of forms. When <l>{x) is a poly- 

nomial, the process of representing f{x) by <f>(x) is called parabolic or 
polynomial interpolation; and when (t>(x) is a finite trigonometric series, 
the process is trigonometric interpolation. In like manner, <f){x) may be 
a series of exjionential functions, Legendre polynomials, Bessel functions, 
etc. In practical problems we always choose for (f}{x) the simplest func- 
tion which will rep're^ent the given function ov(‘r tht‘ internal in question. 
Since polynomials are the simplest functions, we usually take a polynomial 
for (l>{x), and nearly all the standard formulas of interpolation are poly- 

* The author thinks that this process of replacing a oomplioateil function by a 
simpler one .should be called the principle of analytical replacement or the principle 
of functional substitution. 



52 


INTERPOLATION— NEWTON’S FORMULAS 


[Chap. II 


nomial formulas. In case the given function is known to be periodic, 
however, it is better to represent it by a trigonometric series. 

The justification for replacing a given function by a polynomial or by a 
trigonometric series rests on two theorems proved by Weierstrass * in 1885. 
These theorems may be stated as follows: 

I. Every function which is continuous in an interval (a, h) can be repre- 
sented in that interval, to any desired degree of accuracy, by a polynomial; 
that is, it is possible to find a polynomial P{x) such that | f{x) — P{x) \ < c 
for every value of x in the interval (a,b), where € is any preassigned 
positive quantity. 

II. Every continuous function of period 2Tr can be represented by a finite 
trigonometric series of the form 

g (a:) = + ai sin x a 2 sin + ' ‘ ' + fl-n sin 7ix 

-I- hi cos J* + ^2 c'os 2;r -f- ■ ‘ ' + cos nx ; 

or I f{x) — ^ values of x in the interval considered, where 

S represents any preassigned positive quantity. 



Geometrically these tlieorems mean that, having drawn the graphs of 
y = /(•^)? y = /(^) + y = fi^) — possible to find a polynomial 

or a finite trigoiionietnc series whose graph remains within the region 
bounded by y = f{x) -j- € and y = f{x) — c for all values of x between a 
and b, however small c may be. (See Eig. 1.) These theorems mean, 
tber(dbr(‘, tliat the given function may Ua re})la('(*d by a polynomial or by a 
finite trigonometric series to any desired degree of accuracy. 


* Oher die analytxsche Darstellbai keit soyenannler willktirlicher Funktionen eincT 
reeleri V erandcrhchcn ( Sitzunjifsbericliie der Kgl. Ak. der Wisa., 1885). 
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16. Differences. If yi, yj, • * * yn denote a set of values of any func- 
tion y — f{x), then — t/o, 3/2 — VuVa — 3/2.' * ‘ Vn — 3 /«-i are called the 

first differences of the function y. Denoting these differences by At/o?, 
^yiy ^y2y etc., we have Ayo = 3^1 — 3/0. Ay^ = y., — y „ • ■ • Ay„.a = y„ — y„_i, 
Ay„ = yn*i — yn. 

The differences of thcwse first differences are called second differences. 
Denoting them by A^yo, A'-'yi, etc., we have 

A^yo = Ayi — Ayo = y^ — 2 y, + yo, 

A^y, = Ay^ — Ayi = ya — 2y2 -f y,, 

etc. 

In like manner, the third differences are 

A®yo == A^y, — A^yo = y:, — Sy^ + 3yi — yo, 

A®yi = A^ya — A^y, =y^ — Sya + Syg — yi, 
etc. 

The following difference table shows how the differences of all orders 
are formed : 


w 

y 

^y 

A*y 

A*y 

A*y 

A'j/ 

^«y 

AV 

A*y 

Ofi, 

2/0 

^2/0 








a?, 

Vx 

A3/1 

AV. 

A»yo 







y% 

Ay, 

A*y, 

A*yj 

A*yo 

A-'yo 




a>. 

y% 

Aya 

A*ya 

A*ya 

AVi 

A'^yi 

A®yo 

A'^yo 


jp* 

2/4 

Ay4 

A^ya 

A-ya 

A"ya 

A-^y. 

A*yi 

A^y, 

A*yo 


y* 

Ay* 

A^y* 

A-y* 

A‘y3 

A“yB 

AVa 




2/» 

Ay. 

A»y* 

A>y» 

A^y* 





fl?T 

2/7 

Ay7 

A®y. 







a?* 

y% 










Table 1. Diagonal Difference Table. 


This table is called a diagonal d ifference_table. The majority of dif- 
ference tables are of this kind, but for many purposes a more compact 
table, called a horizontal difference taWe, is preferable. In the horizontal 
difference tables the differences of different order are denoted by subscripts 
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instead of exponents. losing the notation for horizontal differences, we can 
rewrite the preceding difference table in the horizontal form as follow-v 


m 

y 

\y 

Ajt; 

AaJ/ 

A*!/ 

AbJ/ 

A^V 

At2 / 

A».V 

(Pq 











.Vi 

Ai2/i 









2/a 

A|J /3 

^ty% 








2/3 

Ajj/s 

A,J/a 

Aal/a 






W, 

y* 

Ai3/4 

A33/4 

A3I/4 







2/p 

A,1 /b 

A2I/5 

A.-, 1 /r. 

^*yi 

AbJ/b 





2/e 


Aji/n 

A32/6 

A 4/8 

Ab!/* 

AbI/b 




2/7 

Ai2/i 

Aa3/T 

^zyj 

A 42 /T 

AnS/i 

Ab 2/7 

AtS/t 


OOn 

2/8 


A32/8 

Ajt/s 

A43/8 

Ast/s 

A«i/b 

A7y« 

Ab2 /« 


Table 2 Horizontal Difference Table. 


In order to see the relation between horizontal and diagonal differences 
of the same order, we give in Tables 3 and 4 the differences of both kinds 
in terms of the y’s. 

Inspection of these tables shows that the top diagonal Imo is the same 
in both, hut that the bottom uj>\va/dly inclined diagonal in Tabic 3 is the 
same as the bottom horizontal line in Table 4. Also, from Table 3 we have, 
for examjile, 

.^4 — 3 ?/, + 3 t /, — y ,. 

Likewise, from Table 4 ^^e have 

A--J/4 = - 3//., + 3i/, y^, 

Hence 

A'y, = A,,y4. 

A glance at Tables 3 and 4 will show that the general relation between 
the A’s affected with exponents and those affected with subscripts is 

A^yk = ^myk^m (going forward from y^) , 
or 

An,yn = ^"^yn-m (going backward from y„), 

where m, denotes the order of differences and k and n the number of the 
tabulated value. 

The relation between diagonal differences and horizontal differences 
can be illustrated still further by a numerical example. The tables on 
page 56 show both kinds of differences for a set of equidistant values of 
the function y = siiih x. 
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I I 


I 


+ 


I 


-h 

»o 

I 


t t 

o »o 
I 1 


1^ 

+ 

o 

7 

o 

7 

j 


+ 

si 

I 

CO 

t 

;S 

1^ 


+ 

:S, 

I 

CO 

-f 

I 


2ji 5ji 

t t 

1 I 


+ 


CO 

+ 


+ 

L 

CO 

+ 


=r> fe. SSi 


I 

Si 


SJl 

I 


sji ajb 5^, 

CO CO CO 

t t t 

Si 

CO CO CO 

L L L 

S, S, ;S 


I I 


+ 

Si 

CO 

I 


-h 

Si 

CM 

L 

s 


-f 

s 

CM 

1^ 

s. 


=31 :si in 


t 

s 

CM 

I 

s 


+ 

CM 

I 

s 


I 


=34 

I 


1^ 


t I 


IG 

O 

a 

o 



® -< e« *9 

^3 Si SSi Si 

i 1 1 1 


•III 

— e« ««9 » 

Si ;3i s> Si 
uo lo »0 lO 

-f-h-f-t 


Si ^ 2h Si 

o o o o 

1 7 1 7 

< 

Si S> Si Si 

oooo 

r—t 1 —i T—^ 1 — ( 

++++ 


lO lO lO *o 
till 


1111 
kO «0 t- GO 


Si Si Si Si Si 


S s. s s s 

-rr rr -j' 

1 1 1 1 I 

<1 

1 1 1 1 1 

s Si Si Si Si 

CO CO CO CO CO 


S S S S si 

Tf rf rt* -r 

1 1 1 1 1 


1 1 1 I 1 

Sj Si Si S, Si 


S} Si Si Si Si Si 

1 1 1 1 1 1 

<1 

1 1 1 1 1 1 

Si Si Si Si Si Sri 
CO CO CO CO CO CO 


si S> S S, S) Si 
CO CO CO CO CO CO 

1 1 1 1 t ( 


I 1 1 1 1 1 

r-. ^ lO ® r- oc 


s s s s s s s 


Si Si Si Si Si Si Si 

CM CM CM CM CM CM 

1 1 1 1 1 1 1 


1 1 1 1 1 1 1 

Si S S S Si s s 


s s s s s s s s 

1 1 . 1 1 1 1 1 1 

< 

1 1 ' 1 1 1 1 1 1 

Si Si s s s s s s 

1 

Si Si Si Si Si Si S Si Si 


Table 4. Horizontal Differences. 
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X 

y 

Ay 

A*y 

A^y 

A*y 

A^y 

A*y 

1.6 

2.12928 

24629 






1.6 

2 37557 

27006 

2377 

271 




1 7 

2.64563 

29664 

2648 

297 

26 

3 


1 8 

2 94217 

32699 

1 2945 

326 

29 

4 

1 

1 9 

3 26816 

35870 

3271 

359 

33 



2 0 

3 62686 ; 

39500 

3630 





2 1 

4 02186 

1 








T 

y 




Xy 


^ay 

1 5 

2 12928 







1.6 

2 37557 

24629 1 






1.7 

2 64536 

27006 

2377 





1 8 

2 94217 

29654 

2648 

! 271 




1 9 

3 26816 

32599 

2945 

297 

26 



2 0 

3 62686 

35870 

3271 

326 

20 

3 


2 1 

4 02186 

39500 

3630 

359 

33 

4 

1 


It will be observed that the differences for the seven functional values 
are the same whether written as diagonal differences or as horizontal 
differences. 

In certain work, however, horizontal difference tables have distinct ad- 
vantages. Tn the numerical solution of differential equations, for example, 
the functional values behind us are always known, but those ahead of us 
are always unknown. Here the horizontal difference table shows all oiders 
of differences on the same line as the last known value of the function, and 
these differences are used for finding the next computed value of the func- 
tion. The horizontal type of difft^rence table is more compact and con- 
venient in this case than the diagonal type would be. 

On the other hand, when we take up the s tudy of central-difference inter- 
polation in the next chapter, we shall find that a diagonal difference table 
is much better for that purpose. 
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17. Effect of an Error in a Tabular Value. Let yo, y^, y^, ’ ■ • yn be 

the true values of a function, and suppose the value y^ to be affected with 
an error c, so thbt its erroneous value is y., + €. Then the successive 
differences of the y^s are as shown below : 


y 

^2/ 

AV 

A*y 

A*y 

Vo 

Ayo 




Vx 

^2/i 

A“yo 

A“yo 


J/a 

Ay, 

A®y, 

A-y, 

A^yo 

y-i 

Ay, 

A«y, 

A»y, + e 

A*y, -h e 

2/4 

Ay4 -f « 

A^y, + e 

A“ya — 3c 

A*y, — 4c 

2/0 -1- c 

Ay^^ c 

A“y4 — 2e 

A=‘y4 + 36 

A*y, 6e 

2/« 

Ay<, 

A“yB + € 

A®yB — c 

A*y4 — 4« 

2/t 

Ayr 

A*y« 

A»y. 

A^y* + c 

2/8 

Ay, 

A*y, 

A»yT 

A*y, 

2/9 

Ayo 

A»y, 



2/ 10 





Table 5. 

, Show ing 

the effect of an 

i error in the tabular values. 

This table shows 

that the 

effect of an 

error increases 

i with the successive 

differences, that the coefficients of the c’ 

s are the binomial coefficients with 

alternating signs, 

and that algebraic 

sum of the errors in any difference 

column is zero. 

It shows 

also that 

maximum error in the differences 

is in the same horizontal line as the erroneous tabular 

’ value. 

The following table shov 

r'8 the effect of an error in a 

horizontal difference 

table : 





y 

Ajy 

A,y 

Aiiy 

^aV 

2/o 





2/i 

^tVx 




2/a 

A,y, 

A,y, 



2/a 

Aiy, 

A,y3 

A,ya 


2/4 

A,y« 

A,y4 

A ay* 

^aVa 

2/o + ^ 

A,yB + « 

Aay, H- e 

Asy* + < 

A4y» -h « 

2/6 

A.y* — € 

A,ya — 2e 

A,y« — 3ff 

A4y* — 4« 

2/t 

A,yT 

A,yT -i- e 

A,y7 3e 

ABy, -p Oe 

2/6 

A,y. 

A,y, 

A^/a — « 

A^y, — 4e 

2/6 

A,y. 

Aa/6 

Aa/» 

AbV. + e 

2/36 

Ao/io 

Aayio 

Aiyio 

A«yM 


Table 6. 



58 


INTERPOLATION-NEWTON’S FORMULAS 


[Chap. II 


Here, again, the effect of the error is the same as in the preceding table, 
but in tliis table the first erroneous difference of any order is in the same 
horizontal line as the erroneous tabular value. 

The law according to whicli an error is propagated in a difference table 
enables us to trace such an error to its source and correct it. As an illus- 
tration of the j)rocess of detecting and correcting an error in a tabulated 
function, lot us consider the following table: * 


X 

y 

All/ 


A3?y 


c 

0.10 

0.09983 




1 


0 15 

0.14944 

1 4961 





0 20 

0 19867 

4923 

- 38 




0 25 

0 24740 

4873 

- 60 

-12 



0 30 

0 29552 

4812 

- 61 

-11 

1 


0 35 

0 34290 

4738 

- 74 

-13 

- 2 


0 40 

0 38945 

4655 

- 83 

- 9 

4 

c 

0 45 

0 43497 

4552 

-103 

-20 

-11 

-4e 

0 50 

0 47943 

4446 

-106 

- 3 

17 

6e 

0 55 

0 52269 

4326 

-120 

-14 

! -11 

-4€ 

0 60 

0 56464 

4195 

-131 

-11 

3 

€ 

0 65 

0 60519 

4055 

-140 

- 9 

2 


0 70 

0 64422 

3903 

t -152 

-12 

- 3 



Here the third differences are quite irregular near the middle of the 
column, and the fourth differences are still more ii regular. The irregularity 
begins in each column on the horizontal line corresponding to x = 0.40. 

Since the algebraic sum of the fourth differences is 1, the average value 
of the fourth differences is only about 0.3 of a unit in tht‘ fifth decimal 
place. Hence the fourth differences found jii tliis example are mostly 
accumulated errors. Keforring now to Table (>, we have 

— 4c = — 11, 6c== 17, etc. 

Hence, c = .3 to the nearest unit. The true value of y corresponding to 
X = 0.40 is therefore 0.38945 — 0.00003 = 0.3894^3, since {ijk + t) — f^ = yk- 
The columns of differences can now be corrected, and it will be found that 
the third differences aie practically constant. 

* Note. When writing numerical difTcrenre tables, or when substituting numerical 
differences in formulas, it is customary to omit the zeros between the decimal point 
and the first significant figure to the ught of it; in other w'ords, the differences are 
expressed in units of the last figure retained. Thus, instead of writing — 0.00038 as 
the first number in the column we write simply — 38. This practice will be 
followed throughout this book, except in a few instances where the zeros are written 
for the sake of clearness. 
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If several tabular values of the function are affected with errors the 
successive differences of the function will become irregular, but it is not 
an easy matter to determine the sources and magnitudes of the separate 
errors. 

In the case where each of the tabulated y’s is affected with an error 
of magnitude c, each of the third differences is affected with an error 
cjk — 3 €*_i + 3 cjk _2 — Q:-a, each of the fourth differences with an error 
cjk — 4c*.i + 6 €a :-2 — -f- €fc_ 4 , etc., as is evident from Tables 3 and 4. 

In practical problems the tabulated values of the function y are obtained 
by measurement or by computation. They are thus liable to be affected with 
errors of measurement or with errors due to rounding off the computed 
results to the given number of figures. In either case these errors would 
be magnified in the process of taking differences and they alone would be 
sufficient to cause the higher differences to become irregular.* For this 
reason it is usually not advisable to use differences higher than the fourth. 

18. Relation Between Differences and Derivatives. It is sometimes 
desirable to know the relations which exist between differences and deriva- 
tives. The fundamental relations between them are : 


(18.1) 

and 


A”/ (x) = {x -(- OnAx), 


lim 


(Ax)^ 


= /W(x). 


o<e<i 


These relations are derived in Vallee-Poussin's Cowrs d' Analyse Infinitesi- 
male, I (fourth edition, 1921), pp. 72-73. 


19. Differences of a Polynomial. I^et us now compute the successive 
differences of a polynomial of the 7 ^th degree. We have 


( 1 ) y = f(x) = or" 4- hx^~^ cx^~^ -f- ■ ■ ' + -|- Z. 

(3) y + £iy =a{x + h)’^ + b{x + h)”-^ + c{x + + ■ ■ ■ 

k (^x h) I, 

where h = Ax. 

Subtracting ( 1 ) from ( 2 ), we get 

Ay a[{x A- + fe[(a: + Z?)”-^ — 

+ c[(rr+/i)”“2_a;n-2j ]ch. 


* For an exhaustive discussion of errors in the tabular values of a function, see 
Rice’s Theory and Practice of Interpolation, pp. 7-15 and 46-62. Also O. Biermann's 
Vorlesungen iiber Mathematisohe Ndherungsmethoden, p. 136. 
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Expanding the quantities {x + etc. by the binomial 

theorem^ we have 

Ay = a Fx'* + nAx"~^ -f ^ 

L. o I 

4 - . . +l> 4- (n—l)/ix'‘-^ 4- (^— 

+ • • ■ — 4“ c 4" (”■ — 2)hx'‘~^ -f- — ~^2~ 

+ ■ ■ - -a:"-*] + • • • + M, 
or 

Ay = an/ix^~^ + ^ 


Now if A.t(==A) is constant, the bracketed coefficients of etc. 

are constants, so that we may rpplace them by the single constant coeffi- 
cients 6', c', etc. Hence we have 

(3) Ay = an/ix^~^ -f- f/x^~^ 4“ c'x”"® + * ' * + fc'a: + 

The first difference of a polynomial of the nth degree is thus another poly- 
nomial of degree n — 1. 

To find the second difference we give x an increment Ax h in (3) 
and therefore have 


(4) Ay + A(Ay) *= arfk(x + h)^-^ + &'(x -f 

+ (/(x + h)»-^ + • • • + + h) + I'. 

Subtracting (3) from (4), we get 

A(Ay) = A^y = anh[(x h)^'^ — x^~'^1 

-^b'\_{x + h)^-^ — x^-^]+c'[{x + h)^ — x^-^']+’ • ‘ + 

Expanding (x + ^)”'S ^tc. by the binomial theorem and re- 
placing the constant coefficients of x"’*, etc. by a single letter as 

before, we have 

A^y an(n — I ) h^x^''^ -f 6"x”“® + c"x""* • • • -[- A;"x + 

The second difference is thus a polynomial of degree n — 2. 
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By continuing the calculation in this manner we arrive at a polynomial 
of zero degree for the nth difference ; that is, 

A"y**a[n(n — l)(n. — 2) • • ‘ = anlh^x^ ^ ah^nl. 

The nth difference is therefore constant, and all higher differences are zero. 

The reader should bear in mind that this result is true only when is a 
constant, that is, when the values of x are in arithmetic progression. 

The proposition which we have just proved may be stated as follows: 
The nth differences of a polynomial of the nth degree are constant when 
the values of the independent variable are taken in arithmetic progression, 
that is, at equcd intervals apart. 

The converse of this proposition is also true, namely : 

If the nth differences of a tabulated function are constant when the values^^ 
of the independent variable are taken in arithmetic progression, the function 
is a polynomial of degree n.* 

This second proposition enables us to replace any function by a poly- 
nomial if its differences of some order become constant or nearly so. Thus, 
the function tabulated in Art. 17 can be represented by a polynomial of 
the third degree, since the corrected third differences are approximately 
constant. 

20. Newton’s Formula for Forward Interpolation. Our next problem 
is to find suitable polynomials for replacing any given function over a 
given interval. Let y = f{x) denote a function which takes the values 
yo,yify 2 ,‘ * 'yn for the equidistant valu^ Xo,Xi,X 2 ,' • ' Xn oi the inde- 
pendent variable x, and let (t>{x) denote a polynomial of the nth degree. 
This polynomial may be written in the form 

(1) <f>(x) = 0 ^, + ai{x — Xo) + a 2 {x — Xo) (x — x^) 

+ a 3 (x — Xo) (x — Xi) (x — Xz) 

+ a^{x — Xo) (ic — Xi) (x — Xz) (x — Xa) 

”1“ ■ ■ ' “1“ CUn ( X Xq ) {^X Xj ) ( X Xz ) ■ ' * ( X Xn-i ) . 

We shall now determine the coefficients ao, a^, an, - - • an so as to make 
<(>{xo)=yo, <p(3:i)=yi, <^( 2 : 2 ) =y«. 

Substituting in ( 1 ) the successive values Xq, x^, • ■ ■ x„ for x, at 
the same time putting 4,{xo) = y», 4>{xi) = y,, etc., and remembering that 
Xi — Xo = h, Xj — Xo = 2h, etc., we have 

* For the proof of this proposition see Rice’s Thebry and Practice of Interpolation, 

p. 24. 
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y© or ^0 ““ yo* 

jfi =• fto ®i (^1 — ^o) — yo dji. 
yi — yo Ayo 


y2 = Oo + Oi (Xj — x„) + 02(^2 — Xg) (X2 — Xi) =yo + (2A) 


fl2 


-f- (I 2 (2^) • 

Vz — 2yi 4- yn A“yo 


2^=* 2^=* ■ 
ys — Oo + «i (2:3 — x„) + — Xo) (X3 

+ <*3(^3 Xo) (X3 X,) (X3 X2) 


x.) 


■yo+--J^ (3h) i3h){2h) +agi3h){2h)ih). 


. . 03 = 


y3 — 3y2 + 3yi — y,, 

6h^ 3 !A» ■ 

y4*=Oo4-ai(x4 — Xo) +a2(a-4 — Xo)(x4 — Xi) 

+ aa(X4 — Xo)(X4 — Xi) (X4 — X2) 

+ 04(X4 Xo) (X4 X]) (2:4 X2) (X, X3) 

-s. + ^-^ («) + («)<3») 


+ 


ys — 3y2 + 3yi — y« 

6h^ 


(ih) {3h) (2/^) + a,{4h) {3h) i2h){h). 


at ■■ 


y* — ^y j -I- 6y2 — 4y, + ^ A*yo 

4!A‘ ' 4 \h* ' 


By continuing this method of calculating the coefficients we shall find that 


06 


A’yo 
5!A» ’ 


Ofl = 


A*y.. 


A"yo 


6 !A« ’ " n !/i» ■ 

Substituting these values of Oo, Oi, • • • a„ in (1), we get 

(2) 4/>(x) =yo +^fx — Xo) +^^(x — x„)(x — Xi) 


h 
A*yo 


3!h’ 

A*yo 


(X Xo) (X Xj) (X X2) 


+ ;^^(x — Xo)(x — xi)(x — X2)(x — X3) + •■• 

+ — a:o) (x — x,)(x — X2) • • • (x — x„.i). 

This is Newton^s formula for forward interpolation, written in terms of x. 



Art. 20J 


NEWTON’S FORMULA (I) 


63 


The formula can be simplified by a change of variable. Lot us first write 
(2) in the following equivalent form: 


I — Xo\/x — Xi\/x — XjX 

31 \ A J\ h )\ h ) 

A*yofx — xA/x — Xt\/x — xA/x — XbN . 
+ 4! V A )\ h )\ h )\ h 

Now put 

- , or X = Xo + 


Then since Xi = Xo + A, Xj = Xq + 2A, etc., we have 

X — Xi X — (xo + A) X — Xo — A X — Xo A _ 

~h A A “A A “ 

X — Xj X — (xo 2h) X — Xq 2h ^ 

h ~ A ~ h h ’ 


X — Xn.i X — + (n — l)/z] x — Xp (n — l)fe 

h h h h 

— u — {v — 1) = u — r^+l. 

Substituting in (3) these values of {x — Xq) / h, {x — Xi)/h, etc., we get 
(I) <^(x) == <f,(xo + hu) = g{u) =yo + wAyo + " A®j/o 

I «(«— — 2) .3 I w(« — 1)(“ — 2)(«— ^ 

3i ^yo-t- 41 

+ . . ■ + “(«— 1)(“ — • -(t^— n + 1) 

This is the form in which Newton's formula for forward interpolation 
is usually written. We shall refer to it hereafter as Newton’s formula 
(I).* It will be observed that the coefficients of the A’s are the binomial 
coefficients. 

* Recent historical investigation has shown that this formula was really first dis- 
covered by James Gregory as early as 1670. 



64 INTERPOLATION— NEWTON'S FORMULAS [Chap. II 

The reason for the name “ forward interpolation formula lies in the 
fact that the formula contains values of the tAbulated function from 
onward to the right (forward from yo) and none to the left of this value. 
Because of this fact this formula is used mainly for interpolating the values 
of y near the beginning of a set of tabular values and for extrapolating 
values of y a short distance backward (to the left) from y©- 

The starting point may be any tabular value, but then the formula 
will contain only those values of y which come after the value chosen as 
starting point. 

21 . Newton’s Formula for Backward Interpolation. The formulas of 
the preceding section can not be used for interpolating a value of y near 
the end of the tabular values. To derive a formula for this case we write 
the polynomial <f>{x) in the following form: 

(I'l =ao + ax{x Xn) + ^n) {X Iti-i) 

+ a3(x Xn) {X Xn-i) {X Xn-2) 

+ ai(x Xn)(x--Xn-i)(x—Xn- 2 )(x a:n-3)+' ' * 

+ (ln(x Xn) {r — Tn-i) * * ' {x Xj) . 

Then we determine the coefficients a©, * * • On so as to make </>(xn) ~yn, 

=yn-i, etc. Substituting in (1) the values Xn, Xn-i, etc. for x and 
at the same time putting <t>{x„) =yn, <j>{Xn^i) =yn-i, etc., we have 

J/n = Vn • 

y„.i = tto + ai{x„.i — Xn) = yn + a,( — h). 

• • h = ~r • 

yn-2 = (^0 “I” fl’l {Xn-2 X^n) “f“ a-^{Xn-2 Xn) {^Xn-2 Xn-i ) 

= y. + — — — ( — 2A) -j- Oil — 2h) ( — h). 

y« — 2 y«-i + yn-2 Aay. 

■ ■ “ 2h^ 2h*'' 


By continuing the calculation of the coefficients in this manner we shall find 


as 


Asy, 


A«y 

4 !A« 




Any. , 

nlh” 


Substituting these values of 00,01,02, etc. in ( 1 ), we have 
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(8) ^(a:)— y„ — x„) + — ®n) (* — Xn-i) 

g 1^8 ^**) ' ^n-1 ) {X Xn^2) 

4 j^4 *») a;»_,) (z — a^n-s) (s — ‘^n-a) + ' 


■ ■ - (a; — a^i). 

This is Newton's formula for backward interpolation, written in terms 
of X. It can be , M)lified by making a change of variable, ns was done 
in Art. 20 . 

Let us first write ( 2 ) in the equivalent form 

I ^aVn/x Xn\/x Xn.i\/x ie*-.\ 


Now put 


I Aayn/Z Xn\/X Zn-A/® ®*-*\ 

^ 3 "! V A A )\~h ) 

I ^tVnfx Xv.\/X Xn.i\(x Xn.2\^X Z*.,^ 

il \ h )\ h A h A h ) 

I A„yn /x ZnX /x Zn-i \ /x Zi \ 

n! V h A h / ' ■ A 


+ • • • 


C n 17 

— , or X ^ Xn~\- hu. 


Then since Xn-i =Xn— h, t „_2 =» a;„ — 2 h, etc., we have 
X — a:„_i X — {xn — h) x — Xn-\-h x — x^ , h 

_ _ _ T = “ + i’ 

X Xn-2 X {Xn — 2h) X Xn , 2h 

—h h “ + 


X Xy X \Xn - -(n 1)??1 X Xn , (u 1 ) /l 

_ « + „_!. 

Substituting in ( 3 ) thcase values of (j: — Xn)/h, {x — Xn-i)/h, etc., we get 

(II) i>{x) =<t,{Xn + hu) —V(“) =yn + wA,y„+ — Y^Aayn 


M(tt+l)(M + 2) 


Asyn + 


u{u + 1 ) {u 2 ) {u + S) 


^4yn + ' 


+ + 1 ) (u + 2 ) • • {U + n — 1 ) 

n 1 
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This is the form in which Newton ^s formula for background interpola- 
tion is usually written. We shall refer to this formula hereafter as Newton^s 
formula (11). It is to be observed that this formula employs horizontal 
differences, whereas the formula for forward interpolation employs diagonal 
differences. 

(II) is called the formula for “ backward ” interpolation because it con- 
tains values of the tabulated function from hackivard to the left and none 
to the right of This formula is used mainly for interpoln^ i:ig values 
of y near the end of a set of tabular values, and also for extrapolating values 
oi y 2 l short distance ahead (to the right) of yn- 

We shall now illustrate the use of Newton^s form* by working some 
examples. 

Example 1, Find logio^, having given 

log 3.141 = 0.4970679364, 
log 3.142 = 0.4972061807, 
log 3.143 = 0.4973443810, 
log 3.144 = 0.4974825374, 
log 3.145 = 0.4976206498. 

Solution, We first form the table of differences, as shown below; 


X 

y = log I 

Ay 

A^y 

A«y 

3.141 

0.4970679364 

1382443 



3.142 

0.4972061807 

1382003 

— 440 

1 

3.143 

0.4973443810 

1381564 

— 439 

— 1 

3.144 

0.4974825374 

13^1124 

— 440 


3.145 

0.4976206498 




Here a: = 7r = 3.1415926536, 

Xo = 3.141, h = 

0,001. Hence 



X — X, 3.1415926536 — 3.141 

== 0.5926536, 



““A 

0.001 



u—1 0.4073464, etc. 


Substituting these values in (I) 

, Art. 20, we get 
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logic 0.4970679364 + 0.5926536(1382443) 

0.5926536 (— 0.4073464) (— 440) 

2 

= 0.4970679364 + 0.0000819310 + 0.0000000053 
= 0.4971498727 . 

This result is correct to its last figure. 

Example 2. Using the tabular values of the preceding example, find 
logic 3.140. 

Solution. Here 2 ; = = 3.140, Xq = 3.141, h = 0.001. Hence 



— 2, etc. 

logio 3.140 = 0.4970679364 + (— 1) (1382443) (_440') 

= 0.4970679364 — 0.0001382443 — 0.0000000440 
= 0.4969296481 . 

This result is also correct to its last figure. 

Note. The process of computing the value of a function outside the 
range of given values, as in the example above, is called extrapolation. 
It should be used with caution, but if the function is known to run 
smoothly near the ends of the range of given values, and if h is taken as 
small as it should be, we are usually safe in extrapolating for a distance 
h outside the range of given values. 

Example 3. The hourly declination of the moon for January 1, 1918, 
is given in the following table. Find the declination at 3^ 35“ 15®. 


Hour 

Declination 

Ai 



0 

8° 29' 53' 7 





1 

8 18 19 4 

-ir 

34'. 3 



2 

8 6 43 .5 

-11 

35 .9 

-1' 6 


3 

7 55 6 1 

-11 

37 .4 

-1 5 

O'.l 

4 

7 43 27 .2 

-11 

38 9 

-1 .5 

0 .0 


Solution. Since the desired declination is near the end of the values 
given we use Newton’s formula (H), and we therefore form a horizontal 
difference table, as shown above. Denoting the time in hours by we 
have <n — 4, / — 3*^ 35“ 15% 1. Hence 
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t — tn — 0*^ 24™ 459 




— 14859 
36009 


0.3569. 


.'. u + 1 =0.6431. 


Substituting these values in (II) and denoting the required declination 
by we get 

8 = 7° 43' 27".2 + (— 0.3569) (— 11' 38".9) + ^ 5 ) 

2 

= 7° 43' 27".2 + 4' 9".4 + 0".2 
= 7^ 47' 36".8 . 

Example J^. Using the data of the preceding problem, find the declina- 
tion of the moon at ^ = 5^. 

Solution, Here t = = 5, tn — 4. 

. ^n+i tn h ^ I 1 c\ 

..u ^ 

Substituting in (II), we have 

8 „,i = 7 ° 43' 27".2 +(!)(— 11' 38".9) + (— 1".6) 

=- 7° 31' 46".8 . 

The true value, as given in the American Ephemeris and Nautical Almanac, 
is 7° 31' 46", 9, the error in the extrapolated value thus being only 0".l. 


EXERCISES II 

1 . Find and correct by means of differences the error in the following 
table : 

20736 

28561 

38416 

50625 

65540 

83521 

104976 

130321 

160000. 



EXERCISES 


69 


2. Correct the error in this table: 


19° 

12' 

22".4 

19 

25 

54 .7 

19 

39 

7 .3 

19 

51 

53 .8 

20 

4 

31 .9 

20 

16 

43 .5 

20 

28 

CO 


3 . Find logic sin 37' 23", given 

log sin 37' — 8.0319195 — 10 
‘‘ 38' « 8.0435009 — 10 

« 39' — 8.0547814 — 10 

« « 40' =- 8.0657763 — 10 
« « 41' = 8.0764997 — 10 
« 42' «= 8.0869646 — 10 

« 43' = 8.0971832 — 10. 

4 . The following table gives the longitude of the moon at twelve-hour 
intervals for the first four days of April, 1918. Find the moon’s longitude 
at 8 :50 P. m. on April 2, the day beginning at noon. 


Apr. 

1 

0 

244° 

44' 

20".5 

u 

1 

12 

250 

57 

35 

.7 

(( 

2 

0 

257 

14 

22 

.1 

<6 

2 

12 

263 

35 

8 

.6 

U 

3 

0 

270 

0 

24 

.6 

(( 

3 

12 

276 

30 

39 

.6 


4 

0 

283 

6 

22 

.1. 


5 . Using the data of Exercise 3, find log sin 42' 13". 

6. Using the data of Exercise 4, find the moon’s longitude at 8 :43 

p. M., Apr. 3. 



CHAPTER III 


INTERPOLATION 
CENTRAL-DIFFERENCE FORMULAS 

22. Introduction. Newton’s formulas (I) and (Tl) are fundamental 
and are applicable to nearly all cases of interpolation, but in general they 
do not converge as rapidly as another class of formulas called central- 
difference formulas. These latter formulas employ differences taken as 
nearly as possible from a horizontal line through a diagonal difference 
table, and a glance at Table 3 shows that these differences contain values 
of the function both preceding and following the value through which the 
horizontal line is drawn. The central-difference formulas are therefore 
particularly suited for interpolating values of the function near the middle 
of a tabulated set. 

The most important central-difference formulas are the two known as 
Stirling's formula and Bessel’s formula, respectively. They can be derived 
in several ways, but are most simply derived by an algebraic transformation 
of Newton’s formula (I). 

23. Stirling’s Interpolation Formula. To derive Stirling’s formula we 
first write a diagonal difference table and mark for special consideration 
the tabular value and the differ?nces lying as near as possible to the 
horizontal line through t/o- These quantities are printed in heavy type in 
the table given below. 


y 


A"i/ 

A\t/ 

A * 2 / 

A’’*!/ 

A'*iy 

A\i/ 


y-4 

^y-A 








y-3 

Ay-a 

^""y-A 

A*y_4 






y-2 

Ay-a 

A^'y-a 

A» 3 /_a 

A*.V -4 

A®y_4 




y-x 

Ay-. 

A“l/_a 

A»y-2 

A-t /.3 


A«y_4 



yo 

Ayo 

AVt 


A-y.a 



AV-. 

A«y.4 

Vx 

Aj/i 

A=3/o 

A=2/o 

A\v-i 

A*y.i 

AV-2 

A^y_a 

A-y-a 

yx 

A|/2 

A^V^ 

A’l/, 

A‘yo 

A'yo 

A^y-i 



Vx 

A2/3 

A® 1/2 

A *2^2 

A-y. 





Va 

A?/4 

A®l/a 







yx 










Table 7. 
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Newton’s formula (I), when setting out from yo, is 

(A) y — yo + MAyo + A-yo -f ~ A°yo 

I m(m — l)(w — 2 )(m— 3 ) 

_| 


, m(m — 1)(m — 2)(m — 3)(w — 4) 
rt- r, I ^ 2/o -t- • • • , 

which may be written in the form 

{B) y = i/o “f" Ci^yo “h ~h -f- Ot^*yo -j- C^^^yo -h ' ' ' > 

where the C’s denote the binomial coefficients. 

Let us now put 


(a) 

Ay_, Ayo 

’ 2 

(b) 

A> , A-’y., 

3 2 

(0) 

etc. 

A'^y.a 4" A‘’y_2 

(d) 

nj A’y., + Ay_, 


2 ’ 


These m’s arc thus the arithmetic means of the odd differences immediately 
above and below the horizontal line through y^. 

Our immediate object now is to express At/o, etc. in terms 

of the m’s and the even differences lying on the horizontal line through 
yo. This will be done })y a process of elimination by working from A^o? 
A^^oj ^tc. diagonally upward to the right until the quantities in the 
horizontal line are reached. As an aid to this we shall underline the even 
differences A^y_i, ^^y-z? ^^y~3, wherever they occur in the algebraic 

work which follows, the purpose of the underlining being to call attention 
to the fact that the underlined quantities are not to be eliminated. 

From the definition of differences we have 


= At/o — Ai/_i . 

.’. Ayo = ^‘y-i 4- A7 /_i . 

But Ai/_i = — Ayo, from (a). 

Ai/o = A^y_i 4- — Ayo . 

(1) Ayo = 

To find the value of A^yo in terms of the desired quantities we have 
A^y-i =* A^yo — , 


(e) or 


A^yo = A^y.i 4- A*»y_i . 
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But 

(f) , by definition, 

(g) and A®y_i »= 2m3 — from (b). 

Subtracting (f) from (g) and solving for A*y.i , 


(h) 

A’y.i = ms + . 

Substituting (h) in (e). 

(a) 

A“y„ = A'=t/_, 4 - m-s + ^A‘»/ .. . 

To find A*t/o we start with 


A«y.i = A’lyo — A’jZ-i , 

(i) or 

A®y„ = A®y., + A«y_i 


= VI3 + ^A^y.o + A''y-,. from (li ) 

But 

A-’y., = AVi — AY2 , 

(j) or 

A‘y-1 = A^ + A»y,2 . 

(k) Also, 

A”y-8 = A'y.j — A''y_3 

(1) and 

A'y.2 = 2m5 — A-’y.j, from (c) . 

Subtracting (k) from ( 1 ) and solving for A^y.2 , 

(m) 

A''’’y .2 = 7^5 + ^-A^?y_T . 

Substituting (m) in (j), 

(n) 

A-'y.i == A'y.o + m,, JA";/ . . 

Substituting (n) in (i), 

( 3 ) 

A®yo = Ws 4 - ^A\y.2 4 - w., 4 - iA“y.s . 

For A*yo 

we start with 


A'y., = A<yo — A‘y.i. 

(o) or 

A*yo = A^y.i 4 - A*y., 


= AY2 4 - "is -i- iA-^y + A'y.,, from (n) 

But 


(P) 

A®y-2 = A*y.i — A®y.2 


= A'y-i — ms — lA®y.3, from (m) ; 

(q) and 

A'y.s — A»y,2 — A'y.., . 

(r) Also, 

A*y _4 = A^y.s — A'y .4 

(s) and 

A^y-a = 2m7 — Ay-4, from (d). 
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Subtracting (r) from (s) and solving for , 
(t) AVs = rnT + iA«y,4 . 


Substituting (t) in (q) and solving for A®y_ 2 , 

(u) A® 2/_2 = A^+ m7 
Substituting (u) in (p) and solving for A®y_i , 

(v) A"y_i = mg +|A^+ m^ + i^^y-4 . 

Substituting (v) in (o), 

(4) A^!/o = A^y.o + + 2A”y,a + m-i + ^A^y_4 . 

Now substituting (1), (2), (3), (4) in (B), we get 

2/ *** ^0 + (^1 4" “h C^{Yn^ -|- “h 

+ ('.(///.; + + ^A-*^.., + iA«^.a) 

+ C^i^rrH + W 7 + AV 2 + 2 A Vs + i^V4)^ 


or 


' = 2/0 + + ^T,’' + ^’2 ^ AVi 4 ~ (^2 + 03)171.3 

+ 4 - - + ^4 ^A‘y_2 + forms )ii w.,, A“y „ etc. 


Bcplacing the and by their values, we get 
, A//., + A//o I /</ i^in — 1)\ 

y = j/„ + « - -—J- - - ■ + ~2 ) 


+ A’y- 


/ Ii(u — 1) , u(n — 1)(m — 2)\ AV'j - 

+ V a “ ■ fi ' ) ■ ^ 

, /«(u — T) _|_ 1)(« — 2 ) J_ u(u — 1)(m — 2)(it — 3)\ 

+ 1 ^ 2^ - -jAy., + -- 


or 


, Ay-j + Ay„ w" .. I «(u" — 1) AV„ + AYi 
!(-?. + “ ^ + 8 + 3l J 




By continuing the calculation as above outlined we arrive at Stirling's 
formula, namely: 



74 


INTERPOLATION— CENTRAL DIFFERENCE FORMULAS [Chap. Ill 


(HI) y 


y. + . t + “*"’37 ‘ 


u^ju^ — r-){tr — 2 -) 


6 ! 


A*y-3 + 


A^y-; + A Vi 
2 

A°y-a -|- A-’y^. 
•> 


. u(ir — !-)(«“ — 2-){u^ — 3-) • • ■ [u" — {n — 1)-J 

_ ___ 

V " + A-”~'y-(n-n 

2 

I u-{u^—l'‘){u^ — 2^){vr— '&'-)■ ■ [w--- (»— 1)-'J , 

^ y-”’ 

where u = {x — Xq) / h. 

In this formula there are 2/1 + 1 terms, and the polynomial coincides 
with the given function at the 2?i + 1 points 

u = — ?i, — (n — 1), — (n — 2), * 2, — 1, 0, 1, 2, • ■ n — 2, n — 1, n ; 


or 

x = Xq — nh, Xq — (n — 1 )^, ’ ' ■ Xq — h, Xo, Xq h, • • - Xq + (w — Xq + 71/ 

24. BessePs Interpolation Formulas. The derivation of Ik'ssel’s formula 
of inter])olation is similar to that of Stirling’s. We iirst write down a 
diagonal difference table as before, and mark for special consideration the 
quantities lying as near as jiossible to tlie horizontal line drawn halfway 
between yo and yi. These quantitie‘S are printed in heavy type in the 
table below. 


y 

Ay 

l^y 

A'y 

A*y 

A'j/ 

A"t/ 

A'y 

A^y 

y-* 

Ar/-4 








y~t 

^y-3 

A’j/-. 

A*y-4 






y-i 

^y-i 

^-y-2 

A^y-a 

A*y.4 

A'^y-4 




y-i 

^y-i 


AV a 

A*y_, 

■ A^v_„ 

A”y-4 

A^y_4 


yo 

Ayo 

A“y-t 

A*y-t 

A*y-a 


A"yo 


A«y.4 

y» 



A*yo 

A^y-i 

A"iy_x 

A"y., 

A'^y.a 

A*y-. 

y% 


A*3/, 

A*y» 

A«yo 

A^yo 

A^y-x 



!/s 

Ayj 

A*2/3 

A»y, 

A‘yi 





2/4 

A 1/4 








y. 










Table 8. 
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Let 

US now put 



(a) 

m V° + y^ 

mo= 2 , 

(b) 

„ A*y.i + A=*yo 

(c) 


(d) 

A*y,a + A»y.* 

m. = 


(e) 

A®y_4 + A®y_3 , 

ma = — - — ^ — — , etc. 




The m’s in this case are thus the arithmetic means of the ordinates and 
yi, and of the even differences just above and below the horizontal line 
through t/iy 2 . 

We next write down Newton’s formula (I), starting from the entry y^, 
as was done in Art. 23. Our problem is to express y^, ^y^, J^^yo, ' * • 
in terms of the m’s and the odd differences lying on the horizontal line 
through yi/ 2 - This will be done by an elimination process, by working from 
etc. diagonally upward to the right until we reach the quantities 
in the horizontal line. The odd differences in the horizontal line will be 
underlined in the work which follows, to indicate that they are not to be 
eliminated. 

By definition we have 

Ayo = 2/i — 2^0. 



o 

1 

! 

> 

<< 

o 

But 

2mo — yo. from (a) 


.*. yo = 2mo — yo — Ay„ . 

(1) 

.*. y« = mo — iAyo 


To find A“yo we si art with 


= A-yo — A"y_,, by definition. 

A-yo = A^y_i + . 

But A^y_i = 2m2 — A'-^yo, from (b). 

A-yo = A^y_i + 2m. — A^y^ , 
or 

(2) A‘yo = mo + ■ 

For A^yo we have 

A^y_i = A^yo — A®y_i, by definition. 


(f) 
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(g) But A*y_i = 2 m 4 — from (c), 

(h) and ^^y -2 = A^y_i — by definition. 

Subtracting (h) from (g) and solving for A^y.j, 

(i) AYi ^ ^4 + Wy-2 • 

Substituting (i) in (f), 

(3) A^yo = AYi + . 

To find A^yo we start with 

A‘‘'y_i == A^yo — A^y_,, by definition. 

(j) A"yo = AVi + 

= r?/4 -j- from (i). 

(k) Now A”y _2 = A'^’y.! — A^y.o, by definition. 

( l ) Also A’y_.^ = A^’y,. — ^^y-3, by definition, 

(m) and A"y_j = 2mc -- A^y_.^, from (d). 

Subtracting (1) from (m) and solving for A®y_ 2 , 

(n) AY 2 = + ^A"y_s ■ 

Equating (k) and (n) and solving tor A-'y.,, 

( 0 ) A°y.i = A’^y.o + Wp + ^A'y., . 

Substituting (o) in (j), we get 

(4) A^yo - m, + ^A^y.-, + m„ + jA^a ■ 

Now substituting these values of yo, A-y,„ A’y^, etc. in (A) of Art. 23, 
we have 

y = mo — iAy„ + uAy„ + (m^ -{- iA^y.,) 


+ -f A*y., + iA'‘y.:,) 

+ 2)(m 3) ^ ^ ^A’y.a), 

or, rearranging, 


, / IN. , «(“ — n , r“(“ — 1) 1 w(m— 1) (m — s)"] 

y = m„ + (m — i ) ^yo + w, + 1 'J A'y 

r M(M — l)(u— 2) , ^ — l)(u - -2)(u — 3_^-| 

L 6 k J ‘ 


[ 


u{u — 1) (u — 2 ) — 1 ) (i/ — 2) (u — 3 V 


12 


Ifi 


'J 


-f terms in A"’y, m,-,, and A\/y i . 
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Simplifying and replacing the m’s by their values, we get 


y-^^ + («-i)Ayo + 


u{u — 1 ) + A^yo 

2 2 


I «(« — !)(«— . , u(m — 1)(m+ 1)(m — 2) A*y-i + A«y., 

+ 3 , ^y-^+ 4 , 2 


Now since Ayo = yi — yo, the first two terms can be transformed to 
yo + wAyo. Hence 


y‘=yo + uAyo + 


u{u — l) AVi + A=yo , M(ii — 1 )(m — 


u(u — 1) (m4- 1) (m — 2) A«y _2 + A*y.i 

4! 2 • 

By continuing the calculation as carried out above we arrive at Bessel's 
formula of interpolation : 


(IV) y — yo + wAyo + 


u(u—l) A^y_i -f A^yo 


(u—i)u(u-~l) u (u—l)(u+l)(u — 2) A«y .2 + A*y,i 

-I- 3, ^y-if 4, 2 

(to— 1 )(m+ 1)(m— 2) ^ 

5 ! 

«(«—!)(«+ 1)(u — 2)(« + 2)(m — 3) AY3 + A»y.2 , 

■ 6 ! 2 
. u(u — l)(u+l)(w — 2 )(u+ 2)- • • {« — n.)(u- + n- — 1) 

(2n) ! 

_ A»" y.n + A^"y -nti 


(u — 1 )(m+ l)(u — 2)(to+2) • (w— n)(w + n— 1) 

(2n+l)! * 

If in this formula we put u = i, we get the simple formula 

.. yo + yi 1 A"y- i + ^'yo . 3 + ^*y-i 

y 2 8 2 ”'" 128 2 ■ 

5 A*y-s ~t~ A^y,; ■ 

~ 2 

ri-3-5- • • (2n— 1)3== A="y.„ + A^"y,„„ 

+ 1—1; 2*»(2»)! 2 
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This important special case of Bessel’s formula is called the formula for 
interpolating to halves. It is used for computing values of the function 
midway between any two given values. 

A more syinnieiri(‘al and convenient form of Bessel’s formula is obtained 
by putting u — | = i’, or u = v Making this substitution in (IV), 

we get 


(VI) 


yo + Vi 


+ dAj/o + 


i) A"y., + A=yo , v(v^ — ^) 


2 


3! 


A*y.i 


_ 1 _ (»’" — — I) Ay, + v(v- — i)(v-~^) 

4! 2 5! 


{v^ — — — Y) A«y.3 + 

G! 2 




(v^ — — I) • • [v' — (2n — 1)V4] A=^”y_n + A=‘"y.. 

(2n) ! 

v{v- — — 7 ) • • • — {2n — 1 )'V4] 


{2r> + 1) ! 


2 

'A»»«y.„. 


In formulas (IV) and (VI) there are 2n 2 terms, and the polynomials 
represented by them coincide with the given function at the 2n + 2 points 


u = — n, — ^ + 1, — ri- -j- 2, * • • — 1, 0, 1, 2, • • • n, 7 ? -f 1 ; 

2n+l 2n— 1 3 113 2n—l 2n+l 

^ 2 ’ 2 ’ 2 ’ 2 ’ 2 ’ 2 ’ 2 ’ 2 ’ 


x-=Xo — nh, Xq — {n — l)/i, - • Xq — x^, Xq h,- - X q nh,Xo ~}-(n + 1)A. 

The zero point for the v’s is Xq h/2j whereas for the u’s it is Xq. 

We shall now apply Stirling’s and Bessel’s formulas to some numerical 
examples. 

Example 1. The following table gives the values of ihe probability 
integral 

for certain equidistant values of x Find the value of this integral when 
X = 0.5437. 
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X 

fix) 

A/(i) 

Ay(x) 

A»/(x) 

AVCx) 

0.51 

0.5292437 

86550 




0.52 

0 5378987 

85654 

-896 

-7 


0 53 

0.5464641 

84751 

-903 

-7 

0 

0 54 

0.5549392 

83841 

-910 

“7 

0 

0.55 

0 5633233 

82924 

-917 

-6 

1 

0 56 

0 5716157 

82001 

-923 



0 57 

0 5798158 



1 



Solution. Here we take = 0.54 and x = 0.5437. Since k = 0.01, we 
have 

X — Xo _ 0.5437 — 0.54 _ 0.0037 
“ “ h 0.01 0.01 

(a) Using Stirling’s formula, (111), we have 


0.3'; 


/(0.5437) = 0.5549392 + 0.37- 

( 0 . 37)2 


(84751 + 83841) 
2 


+ 


(-910) + 


0.37(0.372 — 1) (—7 — 7) 


2 ' ' ' 2 6 
=- 0.5549392 0,00311895 — 0.00000023 + 0.00000004. 

_ 0.5580520. 

(b) To find / (0.5437) by Bessel’s formula it is more convenient to use 
(VI). Here 

v = u — ^ = 0.37 — 0.50 = - 0.13. 

Substituting in (VI), we have 

/(0.5437) (-0.13) (83841) 


+ 


0.0169 — 0.25 /— 910 — 917 \ 

2 \ 2 ; 


0.13(0.0169 — 0.25) (—7) 
- 6 


= 0.55913125 ^ 0.00108993 + 0.00001065 

= 0.5580520. 

Examfle Z. The values of for certain equidistant values of x are 
given in the following table. Find the value of e'® when x = 1.7489. 



80 


INTERPOLATION-CENTRAL-DIFFERENCE FORMULAS [Chap. Ill 


X 

C-* 

A 

A* 

A« 

A* 

1.72 

0.1790661479 

-17817379 




1.73 

0.1772844100 

- 17640094 

177265 

-1762 


1.74 

0.1755204006 

-17464571 

175523 

-1749 

+ 13 

1.75 

0.1737739435 

- 17290797 

173774 

-1727 

+22 

1,76 

0.1720448638 

-17118750 

172047 

-1712 

+ 15 

1.77 

0.1703329888 

-16948415 

170335 



1.78 

0.1686381473 






Solution. 

(a) By Stirling’s formula. 

Here we take x = 1.7489, Xq = 1.75, h == 0.01. 


Hence 


1.7489 — 1.7 5 0.0011 

“ ~ 0.01 0.01 


0 . 11 . 


Substituting in (III), we have 
/(1.7489) = 0.17377:39435 — 0.11 


(—17464571 —17290797) 
2 


+ <m21 (,,3774) - 0.1, (!:-"-‘"‘---i) 

— 0.1737739435 + 0.00019115452 
+ 0.00000010513 — 0.00000000315 ; 


or /(1.7489) = c'* = 0,1739652000. 


This value is oorreet to ten decimal places. 


(b) By Bessel’s formula. 

Since the value 1.7489 is nearer to the middle of the interval 1.74 — 1.75 
than it is to the middle of the interval 1.75 — 1.76, we take — 1.74 bo 
as to make v as small as possible. Hence we have 
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1.7489—1.74 „„„ 

. = 0.89, 

v = u i = 0.89 — 0.50 = 0.39. 


.'. /(1. 7489) 


0.1755204006 + 0.173773!»4,35 


2 


- + 0.39(— 17461571) 


^ ^ 0.39- — 0^) ^ ^175523 + 1737 74 j 


+ 


(092 — 0.25) (O .392 — 2.25)/l3 + 22 


24 


5)^13 + 22^ 


= 0.17464717205 — 0.0006cSlllH27 
— 0.00000085190 + O.OOOOOOOOl 11 
4- O.OOOOOOOOOOl ; 

or /( 1.7189) = 0.1739652000, as before. 

We could also lake .ro =■= 1.75, in wliidi case we should have v ■■ 
This would give 

/(1.74S9) -- 0,17290910365 -f 0.00105173862 

+ 0.00000105562 + 0.00000000214 


-0.61. 


— 0.00000000(102 === 0.173 9652000 . 

This value is also eorrei t lo ten (l(‘einuil jihiees, but the series eonvorges 
slightly less rapidly than in the preceding case; and both of these series 
given by Bessel’s formula converge a little less rapidly tlian the one given 
by Stirling’s formula. 


Remarlc. The question naturally arises at this point as to which is the 
more accurate, Stirling’s formula or Bessel’s. The answer is that one is 
about as accurate as the other. For a given table of differences the rapidity 
of convergence depends upon tlie magnitude of u in the case of formula 
(111) and u])on the magnitude of v in the case of formula (VI). The 
smaller the values of u and v tlie more rapidly the series converge. We 
should therefore always choosi’ the starting j)oint .r„ so as^to make u and v 
as small as possible. Jn most cases it is possible to choose the starting point 
so as to make — 0.5 ^ u ^ 0.5 and — 0.5 v ^ 0.5. Tlius, in Example 1 
the starting point was so chosen that ?/ = 0.37, v == — 0.13; and in 
l^lxample 2 we had ?/ = — 0.11, z; = 0.39. It is to la* noted that Bessel’s 
formula converged the more rapidly in the first example and Stirling's 
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the more rapidly in the second, the reason being that v was smaller than 
u in the first case and u smaller than v in the second. 

As a general rule it may be stated that BesseVs formula will give a more 
accurate result when interpolating near the middle of an interval, say 
from u = 0.25 to 0.75 (v = — 0.25 to 0.25); whereas Stirling's formula 
will give the better result when interpolating near the beginning or end 
of an interval, from u = — 0.25 to 0.25, say. 


For another phase of this question see Chapter V. 

Example 3. The following table gives the values of the elliptic integral 


for certain equidistant values of </>. 


d<f} 

V 1 — i sin'-* <t> 

Find the value of F(23°.5). 



F{4>) 

AF 

>1 


A^F 

A*F 

21“ 

0 370634373 

18070778 




22 

0 388705161 

18129780 

59002 

2707 


23 

0.406834931 

18191489 

61709 

2711 

4 

24 

0 425026420 

18255909 

64420 

2704 

-7 

25 

0.443282329 

18323033 

67124 



26 

0.461605362 






Solution. Since we are to find the value of the function halfway between 
two given tabular values, we use formula (V) for interpolating to halves. 
Hence we have 


F(23°.5) 


0.406834931 + 0.425026420 1 61709 + 64420 

2 8 2 


. 4 — 7 

128 2 

0.4159306755— 0.0000078831 = 0.415922792. 


This result is probably correct to its last figure, since the differences in the 
table are perfectly regular and decrease rapidly. 



EXERCISES 
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EXERCISES III 

1. Find logic tan 56' 43".5 by BessePs formula (IV) or (VI), givoti 

log tan 52' — 8.1797626 — 10 
« « 53 «= 8.1880364 — 10 

« 54 =8.1961556 — 10 

« « 55 =8.2041259 — 10 

56 = 8.2119526 — 10 
« 57 = 8.2196408 — 10 

« 58 = 8.2271953 — 10 

“ 59 =8.2346208 — 10. 

2. Find cos 0.806595 by Stirling’s formula, given 

cos 0.8050 = 0.693111235 
0.8055 = 0.692750733 
0.8060 = 0.692390058 
0.8065 = 0.692029210 
« 0.8070 = 0.691668188 
« 0.8075 = 0.691306994 
0.8080 = 0.690945627. 


3. Compute the value of (2/\/ w) when a; = 0.6538, given tho 

following table ; 


X 

(2/-Vir)/Je-**dx 

0 62 

0 6194114 

0 63 

0 6270463 

0 64 

0 6345857 

0 65 

0 6420292 

0 66 

0 6493765 

0 67 

0 6566275 

0 68 

0 6637820 


4 . The mean atmospheric refraction, E, for a star at various altitudes 
above the horizon is given in the table below. Using Bessel’s formula 
for interpolation to halves, find the refraction for a star at an altitude 
of 27° above the horizon. 
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h 

R 

22^ 

2' 23" 3 

24 

2 10 .2 

26 

1 58 .9 

28 

1 49 .2 

30 

1 40 .6 

32 

1 33 0 


5. The declination of the moon at the beginning (noon) of certain days 
in August, 1918, was as given below. Compute the declination for 9:35 
p. M., August 25. 


Aug. 

20, 

— 16^ 

0' 

51" 

.0 

<C 

21 

— 11 

24 

51 

.8 

ii 

22 

— 6 

3 

29 

.4 

(( 

23 

— 0 

17 

25 

.8 

(( 

24 

+ 5 

30 

21 

.5 

« 

25 

10 

56 

40 

.3 

tc 

26 

15 

39 

57 

.8 

({ 

27 

19 

22 

3 

.7 

(i 

28 

21 

49 

48 

.3 

ce 

29 

22 

56 

22 

.8 

it 

30 

22 

41 

54 

.1 


6 . The values of an elliptic integral for certain values of the amplitude 
<t> are given in the table below. Compute the value of the integral when 
c^=:24° 36' 42". 


<t> i F{4>) 


21° 

0 370G34373 

22 

0 388705151 

23 

0 406834931 

24 

- 0 425026420 

25 

0 443282329 

26 

0 461605362 

27 

0 479998225 



CHAPTER IV 


LAGRANGE’S FORMULA. INVERSE INTERPOLATION 

I. LAGRANGE’S FORMULA OF INTERPOLATION 

25. Introduction. The interpolation formulas derived in the preceding 
sections are applicable only when the values of the independent variable 
are given at equidistant intervals. It is sometimes inconvenient or even 
impossible to obtain values of a function for equidistant values of the 
independent variable^ and in such cases it is desirable to have an inter- 
polation formula which involves only such data as may be at hand. We 
shall now derive such a formula. 

26. Lagrange’s Formula. Let (.ro. yo). ( 2 : 2 , ^ 2 ),- * • {^n,yn) 

denote n + 1 corresponding pairs of values of any two variables x and y, 
where y^f(x). We replace the given function by a polynomial of the 
nth degree, which may be written in the following form : 

( 1 ) = Ao(x .Ti)(.r ^3)' • ^n) 

+ . 4 i(x — Xo) {x~X2){x — 0:3) • • • {x Xn) 

+ Aiix — Xo) {x Xi){x — T3) ' ' • {x — Xn) 

+ * * ' 

4- An( 2 ' — a:o) (.r-— a) (.r — • ‘ ‘{x — Xn-i). 

Here there are n + 1 terms and n factors in each term. 

We next determine the n -|- f constants Ao, Au A 2, ' • • An so as to make 

<^(Xo) =2/0? <#>(a;,) =y,, • • • = y«. Putt ing a: === and <^(xo) = yo 

in ( 1 ), we get 

yo A() ( X\) {X() X-y) ’ ■ ■ (^0 Xn) ■ 

( Xq t X j ) * ■ ( 0 >» ) 

Again, putting x = x^, 4>{xi) = yi hi (1), we have 

y,=A^{x^ — .To)(.ri — X2) ■ • ' {Xi — Xn'). 

. . Ih : 

‘ ^ ' (Xi — Xo)(.ri — X2) ' • (x, — Xn) ‘ 

In a similar manner we find 

85 
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A2 “ 


2/2 

(Xz Xo)(X2 Xi)(X2 X3) 


(X 2 X„) ’ 


A„ 


y« ^ 

(x„ Xo)(x„ X,) ■ • ■ (x„ Xri-,) 


Substituting in (1) these values of the ^’s, we get 
^ — Xi)(xo --x.) ■ ■ ■ (x„ — X„)^“ 


+ 


(x — Xo)(x — X2) ■ • ■ (x — x„) 


■ffl 


(Xi — Xo)(x, — Xj) • • • (x, — x„) 

(x — Xo)(x — x,)(x — X,) (r — ■T ,,'' 

(X2 Xo)(X2 Xi)(X2 X3) ■ (x. — 

I — ^0) — ) 

(x„ Xo)(x„ X,)- • • (x„ — x„ , r“' 

This formula can also be written in the form 


+ ■ ■ ■ 


n 77 

where Ih{xi) = (x — Xo) (x — Xi) • • • (x — x„), 


7/'„(x) =-^7/n(x). 

Formulas (VII) and (Vlllj are known as Lagrange’s formula of 
interpolation. The values of the independent variable may or may not 
be equidistant. It is to be noted that Lagrange’s formula does not involve 
the successive differences of the function concerned, and that there is 
nothing in it by which we can estimate the reliability of the results obtained. 

Since Lagrange’s formula is merely a relation between two variables, 
either of which may be taken as the independent variable, it is evident 
that by considering y as the independent variable we can write a formula 
giving X as a function of y. Hence, on interchanging x and y in the right- 
hand niembej of (VII) we get 


(IX) 


^(y) = 
+ 
+ 
+ 


(y--yi)(y — yz)- • -(y — ?/-) 

(yo — yiXyo — yz) • ■ (yo — y™) " 

(y — yo)(y — -Vz) • • -iy — yn) 

(y> — yo)(yi — yz) • ■ • (yi — ?/») 

(y — yo)(y — yi) • • -(y — y^) | . . . 

(yz — yo)(yz — yO- • • (yz — y™) ^ 

(y — y»)(y — yi) - • (y — y"-i) 

(y™ — yo)(yn — yi)- ■ • (yn — yn-O 
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The chief uses of Lagrange’s formula are two: (1) to find any value of 
a function when the given values of the independent variable are not 
equidistant, and (2) to find the value of the independent variable corre- 
sponding to a given value of the function. This second problem is solved 
by means of formula (IX). 

We shall now work two examples to illustrate these uses. 

Example i. The following table gives certain corresponding values of 
X and logio x. Compute the value of log 323.5. 


X 

32L0 

322 8 

324 2 

325.0 

lOgloX 

2 50651 

2 50893 

2 51081 

2.51188 


Solution. Here x = 323.5, Xq = 321.0, Xi = 322.8, X 2 = 
Substituting these values in (VII), we get 


324.2, Xs — 325.0. 


log,o 323.5 


(323.5 — 322.8)(323.5 — 324.2)(323.5 — 325.0) 
(321 — 32'2.8)(321 — 324.2)(321 — 325) 


X 2.50651 


(32 3.5 — 321 )(323.5 — 324.2)(323.5 — 325) ^ 

(322.8 — 321)(322.8- o A a... 


(^ 3.5 


324.2)(322.8-~325) 
■ 321 ) (323.0 — 322. 8)( 323.5 — 325) 


(324.2 — 321)(324.2 — 322.8)(32 1.2 — 32c>) 


X 2.51081 


+ 


(323.5 — 321 )(323.5 — 322.8)(323.5 — 324.2) 


X 2.51188 


(325 — 321)(325 — 322.8)(325 — 324.2) 

= — 0.07996 + 1.18794 -f 1.83897 — 0.43708 
= 2.50987. 

This result is correct to the last figure. 

'^^xam,ple 2. The following table gives the values of the probability 
integral (2/V7r) corresponding to certain values of x. For what 

value of X is this integral equal to ^ ? 


(2/ 

X 

0.4846555 

0 46 

0 4937452 

0 47 

0.5027498 

0 48 

0.5116683 

0.49 
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Solution, Calling y the value of the probability integral, we have 
y === ^ = 0.5, Xo = 0.46, Xi = 0.47, Xo = 0.48, Xs = 0.49. 

Substituting these in (TX), we get 

(0.5 — 0.4937452) (0.5 — 0.5027498) (0.5 — 0.5116683) 

® ~ “(0.4840555 — 0.4937452 )1074846555 — O027498)“ ( 074846555 — br5ri¥6W) X 9*46 
(0.5 — 0.4840555) (0.5 — 0.5027498) (0.5 — 0.5116683) 

+ Tb¥93n52^^b;4846555 ) (0.49374.52 — 0.5027498 ) ( 0r4¥3“f4^— 0.511668^) X 0.47 
(0.5 — 0.4840.555) (0.5 — 0.4937452) (0.5 — 0.5116683) 

( 0..5627T98 — 0.4^¥555 ) ( 075027498 — 0.4937452 )~(7).5b27498 — 0..5lT(¥8.3 ) x 0.48 
( 0.5 — 0.4840555 ) ( 0.5 — 0.4937452 ) ( 0.5 — 0.5027498 ) 

T0751l¥i83“— 0.48465.55110.5116683 — 074937452) ( 0T5 11 0683 — 0.5027498) X 0.49 
62.548 X 27498 x 110083 
“ ““ 90897 X 180943“x~270128 X 0.40 

15.3445 X 27498 x 110083 
90897 X 90040 “x"T7023“r X 0-47 

153445 X 02.548 x 110083 

+ 180943 X 90046 x 8^85 X 0.48 

_ 153445 X 625 48 x 27498 _ 

270128 x'l7‘923rx 891877 X 0.49 

= — 0.0207787 -f 0.157737 + 0.369928 — 0 0299495 

= 0.476937. 

The true value to six decimal jdaces is 0.4769tl6. 

Note. The computation in this problem should be performed by 
logarithms unless a calculating machine is available. 

Remark, The reader who has followed tlirough the comj)utation in 
the two preceding exam])les will have noticed that Lagrange^s formula 
is tedious to apply and involves a great deal of computation. It must 
also be used with care and caution, for if the values of the independent 
variable are not taken close together the results are liable to be very 
inaccurate. For these reasons Lagrange’s formula should not be used 
except in eases where Newton’s, Stirling’s, and Bessel’s formulas are 
inapplicable. 

II. INVERSE INTERPOLATION 

27. Definition. Inverse ivierpolaiion is the process of finding the value 
of the argument corresponding 1o a given value of the function when the 
latter is intermediate between two tabulated values. The problem of 
inverse interpolation can be solved by several methods, but in this book 
we shall explain only three. 
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28. By Lagrange’s Formula. One method of dealing with the problem 
is to use Lagrange’s interpolation formula in the form (IX), in which 
X is expressed as a function of y. Example 2 of the preceding article was 
really a problem in inverse interpolation. We shall therefore not explain 
this method further. 


29. By Successive Approximations. A second method is that of succes- 
sive approximations or iteration. To see how this method is applied let 
us consider Newton’s formula (I), namely, 


u{u — 1) u{u — l)(w — 2) 

' 2^0 + ^^2^0 H A-yo + 


+ 


u{u — l)(u- 


2 

2)(u- 


3! 


A^yo 


-3) 


4 ! 


A^yo 4- • 


( 1 ) 


Transposing and dividing through by Ayo, we have 

y — yo _ u{u — 1 ) A%o _ v(u — {u — 2) A^^y,, 

Ay,) 2Ayo 3 ! Ayo 

u(u — 1) (u — 2) (u — 3) A^yo 
4 ! Ayo ’ 

To get a first approximation for w, we neglect all differences higher 
than the first and therefore have 


Ayo 


The second approximation is obtained by substituting in the right- 
liand side of (1). We then have 


( 2 ) = 


y — ?/'i — I) A*yo — 2) A*yo 


Ayo 2 Ayo 3 ! 

4 ! Ayo 

The third approximation is 


Ayo 


(3) ^ 


( 3 ) 


y — y,) — 1) A^yo — 2) A®yo 

Ayo 2 Ayo 3 ! Ay© 

_ — l)(u<^> — 2)(t/t2) _3) A*yo 

4! Ayo ’ 


And so on for higher approximations. 

We shall now illustrate the method by working an example. 


Example 1. Given a table of values of the probability integral 
{2/y/v) f^e~**dx, for what value of x is this integral equal to J? 
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X 

y 





0 45 

0 4754818 

91737 




0 46 

0 4846555 

90897 

-840 

-11 


0.47 

0.4937452 

90046 

-851 

-10 

1 

0.48 

0 5027408 

89185 

—861 

- 8 

2 

0 49 

0 5116683 

88316 

-869 



0 50 

0 5204999 j 






Solution. Here it is better to use a central-difference formula. 
Inspection shows that the desired value of x lies between 0.47 and 0.48, 
and a rough linear interpolation shows that it is about 0.47§. Hence 
we take Xo = 0.47 and use BesseFs formula. We therefore have 

Xq = 0.47, h = 0.01, y = ^ = 0.5. 

Substituting in BesseFs formula (VT) this value of y and the appropriate 
quantities from the table, we have 

0.5 = 0.49824T5 + 0.0090046i; (— 0.0000856) 

iV 

^ — (_Q oooQojo). 

6 

Transposing and dividing through by 0.0090046, we get 

(4) = 0.1 94623 — {v^— 0.25)(— 0.004753) — 0.25 ){— 0.0000185). 

A first approximation for v is obtained by neglecting all terms beyond 
the first in the right-hand member of (4). Hence 

t;0) = 0.194623. 

Substituting this for v in the right-hand member of (4), we find tne 
second approximation to be 

i;(2) = 0.194623— [(0.194623)" — 0.25](— 0.004753) 

— 0.194623[(0.194623)" — 0.25] (—0.0000185) 

= 0.194623 — 0.001008 — 0.000001 = 0.193614. 


Now substituting this value for v in the right-hand member of (4), we 
find 
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i;(«) = 0.194623 — 0.0010101 — 0.000001 « 0.193612. 

This value differs only slightly from the preceding, and we therefore 
make no further approximations. 

Since u = v ^ and x = Xq-\- hu, we have 
Ti == 0.693612, 

X == 0.47 + 0.01 (0.693612) == 0.47693612. 

This value is correct to six decimal places. 

Note. In this example it is not possible to obtain more than five 
trustworthy figures in the value of v, because the right-hand member of 
(4) is the result of a division by the approximate number 0.0090046, 
the fifth significant figure of which is uncertain. As a matter of fact, 
only the first four figures in v are correct. 

If all differences higher than the second are negligible, the problem of 
inverse interpolation amounts only to the solution of a quadratic equation. 
The following example illustrates this. 

Example 2. Given sinh x = 62, to find x. 

Solution. Forming a difference table as shown below, we find that all 
differences above the second are zero. We also notice that the required 
value of X is slightly greater than 4.82. Hence we take Xo == 4.82 and 
use Stirling’s formula. 


X 

2 / = sinh X 

Ay 


A*y 

4.80 

60 7511 

\ 

6106 



4.81 

61 3617 

6168 

62 

0 

4.82 ' 

61 9785 

6230 

62 

0 

4.83 

62 6015 

6292 

62 


4 84 

63 2307 



i 


Substituting y = 62 in Stirling’s formula, (HI), we have 
62 = 61.9785 + 0.6199w -f 0.0031^^ 
or 31z^2 -f 6199w = 215. 


— 6199 + V(6199)^ _(_ 4 X 31 X 215 _ — 6199 + 6201.15 
62 62 
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Since h ~ 0.01 and x =— x© + hu, we get 

X = 4.82 + 0.01(0.0347) = 4.8203. 

30. By Reversion of Series. The most obvious method of solving the 
problem of inverse interpolation is by reversion of series ; for all the inter- 
polation formulas thus far developed are in the form of a power series, 
and any convergent power series can be reverted. Thus, the power series 

( 1 ) 1/ = ao + aix -j- azx- + asX^ + ‘ + * ' * 

when reverted becomes 





When reverting a series with numerical coefficients, it is better to com- 
pute the c’s from equations (3) and then substitute their values in (2). 

We shall now write Newton’s, Stirling’s, and Bessel’s formulas in the 
form of power series and then write down the values of flo, • • • a 4 

in each case. We stop with fourth differences, but the reader will have 
no difficulty in extending them to higher differences if necessary. 
a) Newton's Formula (I). 


y =* yo + u^yo + 


u(u — 1) , u(u — 1) (?^ — 2 ) 


+ 


3! 


- A-yo 


u(u — l)(u — 2)(u — 3) 

H ^ ^yo 




Mu 

2 


I V 

" 2 




+ 


A«yo ^ 


+ 


A*y, 


24 




u*. 


24 
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( 1 q a*= ^ 

a —Av ^ I ^"yo 

“i-Ayo- 2+3 4 ' 


(^2 = 


A^'Vo A’y,. I ll^^yo 


■* I yo 

2 ”24 ^ 


^•>0 


fc) Stirling's Formula. 

I A- 1 1 1) A 4 

2 / = 2 /o + wrw, -I- H m3 -I A"y_2 

, / m.A / A^w 1 A'‘w2 \ , , , AV..> . 

+ + 8r)“ + — +Tr “■ 

where mi and m ,3 have the values given in Art 23. Here 


fl-o 2 /Oj ^ j ^2 

D 


m.i 

fl'S = — , Cl4 


„ ^^y-1 _ ^*y-i 

2 24 ’ 

^*y-z 
24 ■ 


c) Bessel’s Formula (VI ). 


( mo , 3m4\ , A®y-i\ , /mo 6m4\ , 

”••- T + hf) + (^>'" “ Ti-) ” + (t - ir) ' 

, A®y-1 ,,^44 

^6 ^ 24 ’ 

where m^ mn, have the values given in Art. 24. Here 

m 2 , 3m4 . A®y_i 

--- + , a. = Ajy„ - — - , 


mo 


n 

6 ’ ‘ - 24 


We shall now work Examples 1 and 2 of the preeeding article by reverting 
the series. For Example 1 we use Bessel’s formula as before. From the 
table on page iK) we get 

wio “ 0.4982475, = — 0.0000856, w^ = 0.00000015. 
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ITence 


fl„ = 0.4982475 + = 0.4982582, 


tti = 0.009004G + — = 9.009004G4. 

24 

a. 0.0000428, 


a, = -- 


0.0000010 


0.00000017, 


<24 == 0, practically. 
Since y = ^ = 0.5, we have 


Also 


Hence 

Cl 

C2 

C3 


y — flo _ 0.5 — 0.4982582 
a, 0.00900464 


0.1934336. 



0.0000428 

0.00900464 


0.004753. 


(_ 0.00475.3)" = 0.0000225910, 
0.0000001074, 


£3 

a, 


0.00000017 

0.00900464 


0.00001888. 


— --^ = 0.004753, 

0.00001888 + 2(0.000022591) = 0.00006406, 

0 + 5 (—0.004753) (—0.00001888) — 5(— 0.0000001074) 
0.000000986. 


Substituting these quantities in (2), we get 

V = 0.1934336 + 0.004753(0.1934336)- + 0.00006406(0.1934336)* 
= 0.1934336 + 0.0001778 + 0.00000046 
0.193612. 


Hence 

and 


w = i; + J == 0.693612 

x^Xo + hu^ 0.47 + 0.01 (0.693612) = 0.47693612, 
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which is the same value as found by the method of successive approximations. 
To solve Example 2 we use Stirling’s formula, as before. Here 

= 61.9785, 
a, = 0.6199, 

tta = 0:^^ _ 0.0031, 

fl>3 fl-4 = 0. 

Since y = 62, we have 

y - ao = 62 — 61.9785 = 0.0215. 


Hence 


y — fto 0.0215 




0.6199 
__ 0.0031 

ai 


0.6199 


: 0.034683, 


: 0.005001. 


Cl = — 0.005001, c,. = 2(0.005001 y = 0.00005002, 

Ca = 0, practically. 


Substituting these values in (2), we have 

u = 0.034683 — 0.005001(0.034683)- 
= 0.0347. 


.•. X = 4.82 4- 0.01 (0.0347) = 4.8203, 
as previously found by the method of iteration. 

Remark. The problem of inverse interpolation should be dealt with in 
practice by the iteration process when only a few digits are to be substituted 
in the right-hand member, and by reversion of series when the number of 
digits involved is large. 


EXERCISES IV 

1 . From the data in the following table find by Lagrange’s formulas the 
value of y when x = 102 and the value of x when y = 13.5. 


X 

y 

93.0 

11 38 

96.2 

12 80 

100 0 

14.70 

104.2 

17.07 

108.7 

19.91 
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2 . If cosh a: = 1.28*5, find x by inverse interpolation, using the data in 
the following table : 



cosh X 

0.735 

1 . 2824937 

0.736 

1.2832974 

0 737 

1 2841023 

0 738 

1 2849085 

0.739 

1.2857159 

0.740 

1 2865247 

0 741 

1.2873348 

0.742 

1 2881461 



CHAPTER V 


THE ACCURACY OF INTERPOLATION FORMULAS 

31. Introduction. In the preceding articles we have dealt with poly- 
nomial formulas for representing a given function over an interval. These 
polynomials coincide with the given function at the points (xo, yo), 

^ 2 ), etc. Hence it is reasonable to suppose that we can make these 
polynomials approximate the given function as closely as desired by merely 
increasing the number of coinciding points. Such indeed is the case if we 
don’t attempt to spread over too wide an interval, but the necessity for 
caution in this matter will appear from the following considerations. 

When the number of points rro, ri,.r 2 , • • ’ Xn increases indefinitely, the 
polynomial interpolation formulas become infinite series, called interpola- 
tion series; and just as a power series converges in a certain interval and 
diverges outside the interval, so likewise an interpolation series converges 
and represents the given function over a certain interval but fails to repre- 
sent it outside of that interval. For example, if we should attempt to 
represent the function 1/(1 x^) over the interval — 5^^x^5 by an 

interpolation series, we should find that the series would not represent the 
function at all when :c = 4. As a matter of fact, the series would con- 
verge and represent the function to any desired degree of accuracy between 
a: — 3.63 and x= 3.63, but would diverge and fail to represent it 

outside of this interval.* The investigation of the convergence of inter- 
polation series is a somewhat lengthy matter and requires the use of func- 
tions of a complex variable, t We shall therefore not enter into it, but shall 
merely derive expressions for the remainder terms in the polynomial formu- 
las previously considered. 

32. Remainder Term in Newton’s Formula (I) and in Lagrange’s 
Formula. The derivation of the remainder term in a polynomial inter- 
polation formula is very similar to that of finding the remainder in Taylor’s 


* Runge, “ Dbor enipirische Funktioneii und die Interpolation zwischen aqui- 
diutanten Ordinaten.” Zeitschrift fur Math, und Physik^ vol. XLVI (1901), p. 229. 
See also Steffensen’s Interpolation^ pp. 35-38. 

t The interested reader should consult the paper by Runge, cited above, and also 
the following Borel Monographs: Niirlund, Legons 8ur Ics Series d' Interpolation, 
Paris, 1926. Borel, Legons sur les Fonctions de Variables R6elles et les Develoj pe- 
ments en Siries de Polynomes, Paris, 1905. Montel, Legons sur les Series de Poly- 
nomes d une Variable Gomplexe, Paris, 1910. Also Range’s Theorie und Praxis der 
Reihe, Leipzig, 1904. 
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expansion. Thus, to find the remainder term in Newton’s formula (I) 
and in Lagrange’s formula, we write down the arbitrary function. 


(1) 


F{z) = f{z)~<t,{z)—[f{x) 


w , X -1 ( ( Z — Xi) ■■■ jz — Xn) 

(x Xo) (x Xi) ■■■ (x Xn) ’ 


where f{x) denotes the given function, <t>{x) a polynomial interpolation 
formula, and z a real variable. We shall assume that f{x) is continuous 
and possesses continuous derivatives of all orders within the interval from 
Xq to Xfi, 

Now F(z) vanishes for the n 2 values z = x, Xq, Xi, ■ * ■ Xn', and since 
f(x) is continuous and has continuous derivatives of all orders, the same 
is true of f{z) and hence of F{z), F (z) therefore satisfies the conditions 
of Rolle’s theorem. Hence the first derivative of F{z) vanishes at least 
once between every two consecutive zero values of F{z). Therefore in 
the interval from Xq to Xn, F' {z) must vanish n -\- \ times; F" {z), n times; 
F'"{z), n — 1 times; etc. Hence the (n + f)th derivative of F{z) will 
vanish at least once at some ])oint whose abscissa is 

Since <t>{z) is a polynomial of the nth degre*e, its ( 71 + derivative 
is zero. Furthermore, since the expression {z — a:,,) (2 — Xi) {z ■- Xn) ■ • • 
(z — Xn) is a polynomial of degrc'C 1, it follows that its ( 71 + l)th 
derivative is the same as the (71 -|- 1 )th derivative of which is (71 1) ! 

On differentiating (1) 71 + 1 times with resped to 2 : we therefore have 


ir(n.i) _o_ [/(x) 




(71+1)! ^ 

(x Xo) (x—x,) • ■ ■ {x Xn) ' 


But since ( 2 ) = 0 at some point 2 we have 


0=f(n^^)(i)-[f{x)-i>{x)] 


( 71 + 1) ! 


Hence 


(x — Xo){x — Xi) • ■ ■ (x~ ~ Xn) 


f{x) <f>{x) (x Xo){x—Xi) • • • (X — Xn), 


Now since f(x) — <l>{x) is the difference between the given function and 
the polynomial at any point whose abscissa is x, it rejiresents the error com- 
mitted by replacing the given function by the polynomial. Hence we have 

(2) Error = A’„ = (j: — Xo) {x — Xi) • • -(x — Xn), 

where ^ is some value of x between Xo and a:„. This is the remainder term 
in formula (2) of Art. 20 and in Lagrange’s formula (VII). 

To get the remainder term in formula (I) of Art. 20 we recall that 
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X — Xo^hu,x — Xi ^h{u — \)yX — X 2 =h{u — 2 ), • • • x — Xn’^h{u — n). 
Substituting these values of a; — x^, x — Xiy etc. in ( 2 ) above, we have 

( 3 ) Rn •= u{u—l) (u—2) ■ • • (u—n). 

If the analytical form of the given function f(x) is unknown, then the 
best we can do is to replace by its value in terms of differences. 

From Article 18 we have 


(a) AV(ir) == {x + OriAx), 0 < 0 < 1. 

Putting x==Xo and Ax == h, we have from (a) 

(b) /(") (x, + 0nh) = . 


Now since Xq + nh and ^ are values of x at points within the interval 
of interpolation (that is, l)etween Xo and Xn) we may, for practical purposes, 
put £ = 2:0 + Onh. Making this substitution in (h), we get 


(c) 

Hence we have 

(d) 


(0 


A"/(g) 

h" 


/<”'•» (O = 




y 


practically. Substituting ibis value of in (3), we get 

(4) R„ = ~^^^yiu(u — l)(u — 2) - (u—n). 

The smaller the interval ?i is taken the more nearly does (4) give the 
actual error. 


33. Remainder Term in Newton’s Formula (II), To find a formula 
for the remainder in Newton’s formula for hacku'drd interpolation we write 
down the function 


F(z)==f(z)-4>{z)~-[f{x)-4>(x)] 


(z Xn)(z Xn-i)- ’ (z — Xg) 

(a* a^n)('^ ■ ■ ’(a* Xq) 


differentiate it n + 1 times with respect to z, and put (z) — 0 for 

2 : f . We thus find 

= (x-x„)(x-T„.,)- • -{X-Xo), 

or 

(1) Error = iJ„= 7 — r^^(x — Xn)(x — x„.i)(x — 1 ,- 2 ) • ■ • {x — Xo). 
(n-f-])! 
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This IS the romaindor term for formula (2) of Art 21. 

To find the corresponding formula in terms of u we recall that 


X — Xn 




U 1 , 


■■u + 2,- 


’ Xq 


: ix + n. 


Substituting these values for x — Xn etc. in (1) above, we get 

(2) + !)(« + 2 ) •••(« + to). 

To find a formula for Rn when the analytical form of the given function 
is unknown, we replace by in (2). The result is 


(3) = + • («+n). 

34. Remainder Term in Stirling’s Formula. We next turn our atten- 
tion to the central-difference formulas of Stirling and Bessel. To find 
the remainder term in Stirling’s formula we write down the arbitrary 
function 


(1) F{z)^f{z)~ 4 >{z) 

LA ; 9 \ ), ^ 

This function vanishes for the 2n -f 2 values z = x, Xq, 

X.2,' ■ ’X.n- We assume that f{x) is continuous and has continuous 
derivatives of all orders up to 2n -f- 1. Hence F{z) satisfies the conditions 
of Rollers theorem. Also, since <^(2) is a polynomial of degree 2n, its 
(2?i -j- l)th derivative is zero. Hence on differentiating (1) 2n + 1 times 
and putting = 0 for some value z = we get 


4- I ) t 

from which 


f(x)— 4 .(x)- 


( 2 «. + ]) ! 


-,ix — Xo){x — X,)ix — X.i)- ■ ■ (x — x„)(x ~-x.n), 


or 


(2) Error /?„ = 7 ^' {x — x,){x — x,){x — J -,) • ' ■ {x~x„){x — x.,) 
'' ^ (2/? -f- 1 ) ! 

We write this formula in terms of u as follows: Since 


X — Xo = hUj X — Xi = h{u — 1),- • X — Xn = h{u — n), and 
X — x.i == a: — {xo — h) =*= x — Xo + h ^ hu h h{u 1 ) , 

X — x.2=‘h{u-\-2),' • -x — x^^h{u + n)j 
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we have 

L2n+l/(2n+i) (t\ 

(3) Rn - 

where ^ is some value of x between and Xn. 

If the analytical form of f(x) is unknown, we replace by 

wi 2 n+i^ where 

rrinn.i 

Hence we get from (3) 

(4) Rn = j 2T +\ ) ! — 20 • • • (w" — wO- 

In formulas (3) and (4) n is the number of intervals on each side of Xq. 


35. Remainder Terms in Bessel’s Formulas. The remainder term in 
Bessel’s formulas is derived by first writing down the arbitrary function 


(1) F(z)^f(z)-^(z) 

... - , (z — 3;„) ( 2 — J,)( z — J.i)- (Z — Jn)(^ — ^-n)(g — Jn.l) 

l/W ,). . . (j._3;„)(.r_2r.„)(2-_ j„.,) • 

This function vanishes at the 2ri + 3 points z = a;, x„, i„ i.i, • • -x., 
x^, x„+i. Since <^{z) is a polynomial of degree 2n + 1, its (2n + 2)th 
derivative is zero, lienee on differentiating (1) 2n + 2 times with 
respect to z and putting ^’<'-’■'^'( 2 ) = 0 for some value z = i, we get 

0=/(Zn.2)(^)_0 

(2n 2 ) ! 

from which 

f(x)—<l>(x) = ■ ■ (^ — — .r r,)(x-~x„,, 

or 


(2) Error = Bn 

^ — =^o)(a: — 3 ^i)(x — x-i)- • ■(x — x„Xx — x.„)(x — Xn,:). 

(2n + /<?)! 

Putting x — Xo = hu, x — Xi-=h{u—l), x — x.i = h(u + 1), etc., 
as in the case of Stirling’s formula, we get 


(3) 


Rn — 


)(0 

-(2n + 2)l 


u{u — l)(u + 1)(« — 2) ■ 


• (h — n)(n -f n){u — w - - 1). 
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This is the remainder term in formula (IV) of Art. 24. In terms of 
differences it becomes 


(2n + 2)] ^)(“— ^)(^ + 2) 


‘{u — n) {u n) {u — n — 1), 


where 


2 


On putting u = v ^ in (3) and (4), we get 


( 6 ) Rn = 

( 6 ) 7 ?„ = 




(2n + 2) 


i("’- ^ 


2n+ 1)^' 


These are the remainder terms in formula (VI) of Art. 24. 

Putting i; = 0 in (5) and (6), we get the remainder terms in the 
formula for interpolating to hahes^, namely 

{7) Jtn— (2n + 2)! ^ ^ 2--- 

/Q\ K / -I ■'.ti • 3 o ■ (2n + 1)] - 

( 8 ) — ( 2 „ -(- 2 ) ! ^ 2 -'-' 

36. Recapitulation of Formulas for the Remainder. We now collert 
for easy reference the most important of the formulas derived in this 
chapter. 


1. Newton’s Formula (I) 


(a) n„ 


(n + 1) ! 




-u{u — 1 ) (m — 2) • • • (m — n). 


2. Newton’s Formula (II) 

;,n+if(n.i)/4\ 

(a) Rn = 1 ) ! + ^ ) (“ + '^) ■ ■ ■ (w + " ) 

(h) Rfi ~ II 1 ) (w H- 2) ■ ( (( -J //). 
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S, Stirling's Formula, (III) 

L2n+l/(2n+i)/'t\ 

(a) 1) ! l)(n^-2^)(i^-3^) ■ • {u^-n^ 

Jf, Bessels Formula in terms of u, (TV) 

L2n+2y?(2TI-^2)/£\ 

(a) Bn = o ) I — 1)(^ + 1)(^ — ^) • • •(!/ — n)(w + n)(i/ — n — 


-i^(i/ — l)(u -(- l)(ii- 


(u — n){u n){u — n — 1) 


( 2/1 + 2 )! 

/J. Bessels Formula in terms of v, (VI) 

)(-•-!) - (.-M). 

6*. Formula for Inierpolaling to Halves, (V) 

(a) 

(!') 


' (2/1 + 2)! ^ 

, _ ri -3 5 

" (2// 4- 2)! ^ ^ 


*)2n+2 

D • • (2?? -p 1)]- 


22n.2 


7. Lagrange's Formula, (VJI) 


/(n+i)(^) 

Bn = -/- “ITTV-j -O ■ • ■ (X — Xn), 

[n 1 ) . 


Where the formulas ar(* given in pairs, the second form (h) should be 
used when the analytic form of the function is not known. 

To lessen the labor of computing Bn from these formulas the student 
should, when possible, use the expressions for the nth derivatives given 
on jiage 38. 

It is not worth w^hile to compute the remainder term in many appli- 
cations of hlewton^s, Stirling’s, and Bessel’s formulas, because if the 
starting point is so chosen that u and v are numerically less than 1 and 
if the differences of some order are practically constant, the interpolated 
result will usually be correct to as many figures as arfe given in the 
tabular values of the function. This statement is based on the assumption 
that all available differences are used in the interpolation formula, or at 
least all differences which w'ill contribute anything to the last figure 
retained. It is in those cases where the differences do not become constant 
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or where it is impracticable to make use of differences above a certain 
order that we should compute the remainder term. 

When using Lagrange^s formula, however, the case is very different. 
Here there are no differences available and there is nothing in the formula 
itself by wliich we can estimate the reliability of the results obtained. We 
should therefore compute the remainder term in every application of this 
formula where it is possible to do so. 

It is to be observed, however, that the inherent error in Lagrange’s 
formula involves the (n + l)th derivative of the given function. When the 
analytical form of a function is not known, the inherent error due to the 
use of Lagrange’s formula cannot be estimated. 

The student should observe that the remainder term in Stirling’s formula 
contains odd differences, whereas in Bessel’s formula it contains even 
differences. If, thorefore, when using a central difference formula we stop 
with even differences and wish to estimate the error, we should use 
Stirling’s formula; whereas if we stop with odd differences, we should use 
Bessel’s formula. If this rule is followed, the remainder term will always 
be the next term after the one at which we stop. 

There should never be any difficulty in determining the proper value 
of n to be substituted in the r^unainder formulas. Thus, if we are using 
Bessel’s formula and stop with third differences, the remainder term will 
contain fourth differences. Hence we must have 2n + 2 = 4, or n ==* 1. 
On the other hand, if we are using Stirling’s formula and stop with 
fourth differences, the remainder term will contain fifth differences. Hence 
we shall then have 2n -f- 1 from which v = 2. 

We shall now compute the remainder term in an application of Bessel’s 
formula. 

Examjde. The following table contains values of the function 
y = X* lOx® for certain values of x. Find y when x = 2.27. 


X 

y 



A^y 

A*y 

2.0 

336 0000 

91 8582 




2 1 

427 . 8582 

110 9306 

19 0724 

2.8266 


2.2 

538 7888 

132 8296 

21 8990 

3 0930 

0 2664 

2 3 

671.6184 

157 8216 

24 9920 

3.3714 

0 2784 

2 4 

829 4400 

186.1850 

28 3634 



2.5 

1015.6250 
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Solution, Since we wish to use BessePs formula and compute the 
remainder term, we stop with third differences. Taking Xq — 2.2, x = 2.27, 
h = 0.1, we have 


2.27 — 2.20 0.07 

“ O -oT-"-'- 

V = u — ^ == 0.2. 

538.7888 + 071. 61 84 


2 


^ ^ 0-04 — 0 . 25 ^ ^ 21 . 81 ; 


+ 0.2(132.8296) 
8990 + 24.9920 \ 


= 605.2036 + 26.56592 — 2.46178 — 0.02165, 
or 

y = 629.28609. 


To find Rn we have 2n + 2 = 4, or n = 1, Also 

/IV (a;) 24 + 1200a;. 

Hence 

/•v(^) «= 24 + 1200t 


Now since ^ lies somewiiere between 2.0 and 2.5, we can express it in 
the form 

^ = 2.25 + O.lr;, 

where rj lies between — 2.5 and + 2.5. Substituting this value of ^ in 
above, we get 


/w(^) _ /IV (2.25 + O.I77) = 24 + 2700 + 120^ 
= 2724 + I2O77. 

Hence by (5) of Art. 35 we have 




(0.1)^(2724 4- 120^) _ 2 

. 0.00527 + 0.000232,7 
^ 0.00527 ± 0.00058. 
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We therefore have 


y = 629.28609 + 0.00527 ± 0.00058 


= 629.29136 dt 0.00058. 


The value of y is thus between 629.2919 and 629.2908, or between 
629.292 and 629.291. The correct value to four decimal places is 629.2914, 
and this happens to be the mean of the two limits found above. 

If we substitute differences instead of the derivative in Rn, we have 
^ 2 n +2 == m 4 == (0.2664 -f- 0.2784)/2 *= 0.2724; and therefore by (6) of 
Art. 35 


R. 




= ^^^(0.04 — 0.25) (0.04 — 2.25) 
24 : 


== 0.00527, 

which is the definite part of the remainder term found by using the 
derivative. We then have y = 629.28609 -f- 0.00527 = 629.29136, which 
is correct to four decimal places. 

Note. The substitution ^ + hrj, where denotes the midpoint 

of the range of given values of the function, gives the remainder as the 
sum of two terms, the larger of which is perfectly definite and unaffected 
by the uncertain factor rj. It also saves the trouble of finding the greatest 
and least values of in order to find the limits between which the 

true value of the computed function lies. For Newton’s formulas (I) 
and (II) we make the substitutions £ = Xq + ^ i = — hrj, 

respectively, where rj is now positive in each ca.se. For computing 
in Lagrange’s formula we should put ^ as in the example 

worked above. 

A final remark concerning accuracy must now be made. When the 
analytical form of a function is totally unknown, and the sum total of 
our knowledge of the function consists merely of a set of tabular values 
of the argument, the problem of interpolation is really indeterminate; 
for it is theoretically possible to construct a large number of functions 
which would take the values yo, y^, y 2 , ' ’ ' Vn corresponding to the values 
Xo, Xi, X 2 , • ■ of the argument. Nevertheless, if we have some knowledge 

of the nature of the function with which we are dealing and have no 
reason to believe that it behaves in an erratic manner within the range of 
values considered, we may fairly assume that its graph is a smooth curve, 
in which case the function can safely be replaced by a polynomial. 
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37. The Accuracy of Linear Interpolation from Tables. We shall now 
derive a simple formula for the maximum error inherent in linear inter- 
polation from tables. 

In the remainder after n+1 terms in Newton^s formula (I) let us 
put n — 1. Then i?n becomes 


(1) 


R^ = 


hT(i) 

2 


u{u 1) 


h^M 

2 


(u^ — u), 


where M denotes the maximum absolute value of /"(a;) in any interval 
of width h. To find the maximum numerical value of Ri we differentiate 
it with respect to u, put the derivative equal to zero, solve for u, and then 
substitute this value of w in (1). Hence we have 


dR, 

du 




(2w — 1) 


0 . 


u = ^ and 

i_il 

4 2 1 B ' 

The formula for the maximum error is therefore 



(2) 




nm 
8 * 


Example, The function 1/xV is tabulated in Barlow^s Tables at unit 
intervals from 1 to 12,500. Find the possible error in the linear inter- 
polation of this function when 


Solution. 


N = 650. 



Taking ft = 1, N 650, and substituting in (2), we find 

/r 

= 4 X (650)* 1,098,500,000 ’ , 

or 

E < 0.000000001. 


Note. The student should ever bear in mind that linear interpolation 
is permissible only when first differences are constant, or practically so. 
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He should therefore always compute a few first differences and see if they 
are constant before using linear interpolation. 

EXERCISES V 

1. Estimate the error in your answers to Exercises 3 and 4 of Chapter II. 

2. Compute the error in your answ^ers to Exercises 2, 3^ 4, and 6 of 
Chapter III, 



CHAPTER VI 


INTERPOLATION WITH TWO INDEPENDENT VARIABLES 
TRIGONOMETRIC INTERPOLATION 

38. Introduction. Occasionally it becomes necessary to interpolate a 
function of two arguments. For example, a table of elliptic integrals con- 
tains the two arguments B and on both of which the value of the integral 
depends. 

The problem of double interpolation can be solved in two ways. The sim- 
})lest method in theory is to interpolate first with respect to one variable and 
then With respect to the other. In making these interpolations any one of 
the standard interpolation formulas — Newton^ Stirling's, or BesseFs — may 
be used for either the first interpolations or the second. We always choose 
the most suitable formula for the problem at hand. 

39. Double Interpolation by a Double Application of Single Interpola- 
tion. This method can be explained best by means of examples. 

Example 1. The following table* gives the hour angle (/) of the sun 
corresponding to certain altitudes (a) and declinations {d) at a place 
in a certain latitude. Find the hour angle corresponding to 
a = 16°. 


. 

a = 10° 

14° 

18° j 

o 

CM 


G*- 11“ 26* 

5^ 

50“* 

17* 

5b 

29“ 

27- 

5b 

8“ 

48* 

15° 

5 55 41 

5 

35 

5 

5 

14 

39 

4 

54 

17 

10" 

5 40 16 

5 

19 

56 

4 

59 

37 

4 

39 

17 

5° 

5 24 50 

5 

4 

30 

4 

44 

4 

4 

23 

29 

0° 

5 9 5 

4 

48 

29 

4 

27 

39 

4 

6 

28 


Solution. Here w^e take the entry 5^ 35"™ 5® as the starting point. Then 
the initial values of d and a are do = 15^, Uq = 14*^. 

Let t = f{d,a) denote the functional relation connecting t, d, and a. 
We first find by ordinary interpolation the values of |4®),/(12°, 18°), 
/(12°, 22°). To this end we construct the following difference tables 
corresponding to a == 14°, a = 18°, and a = 22°. 


* A table of this kind is called the function tabic. The entries in this table are 
taken from Whittaker and Robinson’s Calculu.s of Observations, p. 374. 


109 



110 


INTERPOLATION— TWO INDEPENDENT VARIABLES [Chap. VI 


(a) 


(b) 


(c) 


a»14° 


f(d, 14°) 

A/ 

A’/ 

A’/ 

5“ 35" 

05* 






-15“ 09- 



5 19 

56 


-17- 




-15 26 


-18- 

5 04 

30 


-35 




-16 01 



4 48 

29 





a =18° 


Ad, 18°) 

A/ 

AV 

Ay 

5^ 14“ 39- 

-15“ 02- 



4 59 37 

-15 33 

-31- 

- 21 - 

4 44 04 

-10 25 

-52 


4 27 39 





a = 22° 


fid, 22 °) 

A/ 

Ay 

Ay 

4 h 540 

17- 






-15“ 0- 



4 39 

17 


-48- 




1 

00 


-25- 

4 23 

29 

i 

-1“ 13- 




-17 01 



4 06 

28 





Since the required value 16°) of the function is near the beginning 

of the assigned values of d, we use Newton's formula (I) to find /(12°, a). 
Furthermore, sinc e the given equidistant values of d decrease by steps of 5°, 
we have h == — 5° and therefore 

d—do 12 — 15 


u = 


h 


— 5 
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Now substituting in (I) of Art. 20 this value of u and the other quantities 
from table (a) above, we have 

/(12“ 14°) = 5''35'"5® -t- 0.6(— 15"'9») + (—lY*) 

2 

o 

= 5''26”1*. 

Using the values in table (b), we get 

/(12° 18°) = r>''J4"'39» + 0 . 6 (— + 0 - 6 (— 0 - 4 ) 


0.6(— 0.4)(— 1.4) 


(-2P) 


= 5‘'5"'40®. 

In like manner, from table (c) we get 

/(12°, 22°) =4'’r)4'"ir» -|-0.6(— liVU’*) 4-MllZ.Ml (--485) 

/Q 

The next step in the solution is to form a difference table of these func- 
tions just computed. Hence we have 


/(12. a) 

A/ 

A’/ 

S'* 26“ 1* 

-20“ 21 • 


5 5 40 

-20 19 

+2* 

4 45 21 




Now since the required value of the function is also near the beginning 
of the assigned values of a, we again use Newton^s formula (1). x\lso, 
since the equidistant values of a increase hv 4^^, we have h = 4^^. Hence 


u — 


a — »(, 



= 0.5. 


Substituting in (1) of Art. 20 this value of u and the other quantities 
from the tables above, we finally get 
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/(12°, 16°) = 5‘-26'”P + 0.5(— 20™2P) + ^ (2') 

— 5**15'“50». 


Note. If it should be required to compute /(14°, 20°), for example, we 
would set out from the entry 5*'5r)“^41® and compute /(14°, 10°), /(14°, 14°), 
/(14°, 18°), and /(14°, 22°) by Newton’s formula (I). Then to find 
/(14°, 20°) we would use New'ton’s formula (II), because the required 
value is near the end of the given values of a. 


Example 2. Find from a table of elliptic integrals the value of 

•8in-i (12/13) fj A 


j, 


Vl — 0.78 sin“ </) 


Solution. Comparing this integral with the standard ellij)tic integral 
of the first kind, namely 

d<^ 


/ * 0 

0 


0 Vl — sin- 6 sin'-^ </> ^ 


we have 


12 


^ = siir^ — = sin”^ (0.9230769) = 67° 22' 48".r) 

i o 

= 67°.38014, 
sin^ e = 0.78, 
sin e = 0.8831761, 

e = 62° 01' 40".4 = 62°.02789. 


In problems of this kind, where extensive tables are at hand, it is better 
to use central-difference formulas. Hence we write down the aj)propriate 
portion of the given function table, compute the necessary difference tables, 
and from them calculate the values of F(60°, 67°. 38014), /<’(61°, 67°. 38014), 
F(62°, 67°.38014), F{63 , 67°.38014), and F(64°, 67°.38014) by means 
of Bessel’s formula (VI), because 67°. 380 14 is near the middle of an 
interval. Then we form a difference table from these computed functions 
and find F(62°.02789, 67°.38014) by means of Stirling’s formula, (III), 
because here the value 62°. 02789 is /near the beginning of an interval. 

The function table is given below, and from it the difference tables 
following are computed. 
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0 

6 = 60° 

61° 

62° 

1 

CO 

o 

64° 

65° 

1.3489264 

1 3559464 

1 3630180 

* 1 3701309 

1 . 3772732 

66 

1.3772777 

1.3847727 

1 3923331 

1 3999481 

1 4076057 

67 

1.4059999 

1 4139971 

1 4220753 

1 . 4302236 

1 4384298 

68 

1 4350955 

1 4436231 

1 . 4522494 

1.4609635 

1 4697532 

69 

1 . 4645657 

1 4736530 

1.4828589 

1.4921728 

1 5015826 

70 

1.4944109 

1.5040879 

1 5139061 

1 5238552 

1 5339233 



e^er 



(a) 


(b) 
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e= 62 ° 


0 

F(62°, 4.) 

AF 

A^F 

A‘F 

A'F 

A‘F 

65° 

1 3630180 

293151 





66 

1 3923331 

297422 

4271 

48 



67 

1 4220753 

301741 

4319 

35 

-13 

H-1 

68 

1 4522494 

306095 

4354 

23 

-12 


69 

1 4828589 

310472 

4377 




70 

1 5139061 


i 

i 





e 

= 63° 





F(63°. </») 

AF 

A^F 

A^F 

A*F 

A^F 

65° 

1 3701309 

298172 





66 

1 3999481 

302755 

4593 

61 



67 

1 4302236 

’ 307399 

4644 

1 

50 

-11 

-2 

68 ! 

1 4609635 

1 

312093 

4694 

1 

1 1 

37 I 

-13 


69 ! 

1 

1 

! 

1 4921728 I 

i 

316824 

4731 1 

! 

I 

I 



70 i 

1 5238552 | 

1 


1 


1 

1 




0- 

= 64° 




. 1 

F(64°, >f) 1 

AF 

A^F i 

a^F 

A*F , 

A^F 

65° 

1 3772732 

303325 

1 




66 

1 4076057 

308241 

4916 

77 



67 

1 4384298 

313234 

4993 

67 

-10 

-4 

68 

1 4697532 

318294 

5060 

53 

-14 


69 

1 5015826 

323407 

5113 




70 

1 5339233 







(c) 


(d) 


(e) 
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Here 

= 67°, <^ = 67°.380]4, h==\°, 
u = 0.38014. 
v = « — i 0.11986. 

Substituting in Bessel’s formula (VI) the quantities given in table (a), 
we have 

F(60°, 67°.38014) = 1.4205477 — 0.00348740 -- 0.00004408 
+ 0.00000001 — 0.00000003 
= 1.4170162. 

Ill a similar manner we get from tables {h), (c), (d), (e), 
F(61°,67°.38014) == 1.4252117, 

F(62°, 67°.38014) == 1.4334946, 

F(63°, 67°. 38014) = 1.4418540, 

F(64°, C7°.38014) = 1.4502779. 

Forming now a table of differences from the.se compr.ted fuiutioiis, 
we have 


e 

F{e, 67“ 3S014) 

1 AF i 

1 

A’F 

a^F j 

60° 

61 

1 4170162 

1 4252117 

i 

81955 

1 

874 

1 

i 

62 

1 4334946 

82829 

765 

-109 

1 

63 

1 4418540 

83594 j 

i 

1 

645 

-120 ■ 

1 

64 

1 4502779 

84239 

i 

1 

[ i 

1 

1 

j 


For this interpolation we have 

^0 = 62°, ^=62°.02:89, /i = 1°. 


u = 


e — e„ 

h 


62°.02789 — 62° 
1 °' 


= 0.02789. 


Substituting in Stirling’s formula, (III), this value of u and the appro- 
priate quantities from the table above, we get 
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F(r)2°.02;89, 67^.38014) = 1.4334946 + 0.00023208 

+ 0.00000003 + 0.00000005 
= 1.4337268. 

40. Double or Two-Way Differences. Before explaining the second 
method of dealing with the problem of double interpolation it is necessary 
to define double or two-way differences, to which we now turn our attention. 

Lot z = f {x, y) denote any function of two independent variables x and 
y, and let Zrs = f{Xf, y^) . Let us next construct the following function 
table : 



Xo 

Xi 

X2 

X3 

X4 




Xm 

2/0 

Zoo 

Zio 

Z20 

Zao 

Z40 




Zmo 

2/1 

Zoi 

Z\\ 

Z21 

Z31 

Z41 





2/2 

Z02 

Zi2 

Z22 

Z32 

Z42 





2/3 

Zos 

2 i 3 

Z23 

Z33 

Z43 




3 

2/4 

Zoi 

2 i 4 

Z24 

Z34 

Z44 




Zm* 

2 /ti 

Zov 

j Zin 

Z 2 n 

I Zsn 

1 

Z 4 n 

1 

1 



Zfn n 


We now define double or two-w ay differences as follow^s : 

AjSyQ = Zio Zooi 

^Zoi = Aj^oi = Zii Z^^Jy 

A Z()2 “ Z 12 Z(j2y 


A^^'^00 — Aj/^oo — Zfjj Zqqj 
= Aj^Zio = Zii “ - Zio, 
^ Z20 — Ay 2 jQ = Z21 ^ 20 * 


Or, more generally, 


A^ ^Zrtt ■ — “ ^xZt8 Zr+i,8 Zrgy 

= ^yZm = Zr, 8 +i 2 J/H. 
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Also, 

= A“j5y2Ioo = 

=== = 2^20 ^^10 ~4~ ^00^ 

A^^® 2 !oi = Aj.^ 2 oi = 2-21 22 Jii -|- Z^^l, 

“== = ^22 22:12 -f- 2:02, 

A®^*Zoo = = Z 02 22:01 ~j" 2:ooj 

A^^^Zio = Ay^Zio == Z 12 2zii -j- Zioj 

A®'*^^Z20 = Ay^Z20 = ^22 22-21 “4" ^20? 

A^^'Zoo = A 2 ^® 2 oi — 

A^-^^oo = A^^^Zio — A<>-%0, 

A^^°Zoo = A^^Zoo = 2:30 — 3 z20 + 3 z,o — Zoo, 

A^'^^Zqi = Ajj^Zoi ^81 3 z2i -}~ 3zii Zoi, 

A^^^ZgO = Ay^ZoO = 2:03 3 Zo 2 "4” 3Zoi Zoo, 

A‘^*'^Zio = Ay^Zio = Zi3 3 zi 2 “4“ 3zii — Zio, 

A‘^'*^^Zoo = A^‘*‘®Zoi — A^'*’^Zoo, 

A^*‘^Zoo = A^'^^Zio *" A^^^^Zoo» 

A*"%0 = A^^Zoo == 240 — 4 Z 3 o + 6Z20 “ - 4 Zio + 2:00. 

A^^^*Zoo == Ay^ZoO = ^04 4Zo 3 “4“ ^^02 4Zoi “4“ Zqo-. 

A 2 - 2 ^oo == A-^^Zo 2 — 2 A 2 *^’’Zoi + A^-o^oo, 

= A^‘^“Z2o — 2A«"=^Zio + A^^^Zoo. 

The general formula for writing down these differences is easily seen 
to be 

(1 ) A’"^'>2oo = — 7i.A'""‘2„,„_, + A’"’®2„,„_2 + • ■ • 

+ A^^'200 

= A"*"2:„„ — wA®*"z„,_,.o + ^ A‘>*”z.„.2.o + • • • 

+ A'^-Zoo . 


The symbol A^^'Zoo, for example, means that w'c find the mth difference 
of Zoo with respect to x, y being held constant. 

41. A General Formula for Double Interpolation. We are now in a 

position to consider a general formula for double interpolation. The 
following formula is derived in O. Biermann’e Mathematische Ndherungs- 
methoden, pages 138-144: 
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( 1 ) 2 = f(x, y) = 2 „„ + -- A“**Zoo 

1 r (^ — — a-.) 2(x — Xo)(y — yo) 


AC 


A- 


/ifc 


A>">2„ 


+ 


(y — yo'Xy— .vi) 




A^^®2oo 


] + 


(j' Xo)(x T,) ■ ■ (X— 

},m 


A”'*®2„ 


+ 

I m(x Xn)(x X|) • • ■ (x Tm -My yo) .(,..,,i„ 

' I. ^ 


+ 


m(m — l)(x — Xn)(x — X|) ■ • ■ (x — ■r„, 0(y — yo)(y — y,) 


2 h'"--h-- 

X a<’"-“>^= 2„0 + • • ■ 

(y -».)»->,)■ (i. 

Here h and A* are the intervals between the equidistant values of x and y, 
respectively, and R(xo,yo) is the leinainder term. 

This formula can be simplified by changing the variables from x and y 
to u and t;, as follows : 

Put 

T .To 


Then 


and 


or .r = j*,, + ^ • 
X T, X (.To + ^O ^ ^ 


= u— 1, 


X — X. ^ X — (tq + 2h) ^ _^?JL 2 

h h h h ^ ’ 


X — x„,^, 


= u — (m — 1). 


Also, put 


Then 


y — t/o , , 

V = — - , or 1 / = 7/o + hv. 

y — Vi _ y— (yo + _ y — ih _ i 

' k k k k 


y — y- 


■■ V — 2, etc. 
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Substituting these values of {x — Xo)/h, (y — yo)/^, etc. in (1), we get 
(X) 2 = f{x, y) == f(xo + hu, yo + kv) = 2oo + + vA®*’2uo 

^[u(u — J)A-^%o + 2ui;A'-’2oo + v(v — 1)A" - 200 ] 

-1- [u{y > — l)(u — 2)A®*“2 o9 + 3u(m — l)i;A^"%o 

+ 3mv(v — l)A‘'"“zoo + v{v — ])(d — 2)A®*%o] 

-f- [_u{u — l)(u — 2)(u — 3)A<*‘’2 oo + 4ii(u — 1)(« — 2)i;A-^* '2 ,0 

-|- 6u(u — 1 )d(i; — l)A“*%o + 4:uv(v — l)(t; — 2)A''‘®2oo 
+ V{V 1)(V 2)(V 3)A®*^Zoo] + Rn{Xo, yo), 

where 

Rn(Xo,yo) Y-~{^luiu — l)(u — 2) ■ ■ • (u^w)A'"*»*“2oo 

-^(n-\-l)u{u — 1)('U — 2)* • • [u — (n — l)]vA"*'2oo 
+ — 1)* • • [u — (n — 2)]v(v — 

+ * • ' v{v — l){v — 2)* • ' (v — 

This formula (X) corresponc^s to Newton’s formula (I) and reduces to 
that formula if we put either u == 0 or i; = 0. 

In some applications of mathematics, particularly in Navigation, linear 
interpolation with several arguments is of considerable importance. For 
example, in various navigation tables are tabulated the complete solutions 
of thousands of astronomical triangles. Here the one or two desired parts 
are functions of three arguments. 

Formulas for linear interpolation with several arguments are readily 
found from the general formula (1) of Art. 41 and from extensions of that 
formula. Thus for two arguments, after neglecting all differences higher 
than the first, we have 

(^) z = Zqq -(- — - (Aj-Zoo) “h ~ (^j/2^oo)* 

For a function of three arguments, as u = f{x,y ,z)y w'e have 

3/ 37 *1/ — — \i jj 2 

(3) U = W()()0 ^ (^V^ooo) H" ^ ( ^2^000 ) 1 

and so on for any number of arguments. 
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We shall now apply formula (X) to the two examples which have already 
been worked by the first method. 

Example 3, Solve Example 1 of Art 39 by means of formula (X). 

Solution. For the sake of clearness we repeat the function table given 
in Example 1, and work the problem anew from the start. 


d 

0 = 14° 1 

18° j 

22° 

15° 

S'- 35“ 5* 


14“ 39* 

4h 

54“ 17- 

10° 

5 19 56 

4 

59 37 

4 

39 17 

5° 

5 4 30' 

4 

44 4 

4 

23 29 

0° 

4 48 29 

4 

27 39 

4 

6 28 


Forming next the necessary difference tables, we have 



f do 

A'+o/rfo 



do 

S'" 35” 

5- 








-15“ 9' 



di 

5 

19 

56 


-17* 






-15 26 


-18* 


5 

4 

30 


-35 






-16 1 



d. 

4 

48 

29 





ai= 18 ° 


1 

/«. 




do 

5^* 

14“ 

39* 








• 

a 

7 



d, 

4 

59 

37 


-31 ■ 






-15 33 


-21- 

d2 

4 

44 

4 


-52 






-16 25 



d. 

4 

27 

39 
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02 = 22 “ 



fd2 




do 

4h 

54“ 

17- 








-15“ 0* 



di 

4 

39 

17 


-48* 






-15 48 


-25* 

d* 

4 

23 

29 


- 1“ 13 






-17 1 



di 

4 

6 

28 





These three tables, it will be observed, are the same as tables (a), (h), 
(c) in Example 1. 

We next form difference tables by taking constant values of d. 


do* 15“ 



foa 

A'+'/oo 

A‘>+yoa 

Oo 

5^ 

35“ 

5* 







-20“ 26* 


fli 

5 

14 

39 


+ 4* 





-20 22 


at 

4 

54 

17 




di = 10“ 



/la 


A»«/.a 

Oo 

5** 

19“ 56* 






— 20" 19‘ 


Oi 

4 

59 37 


-1* 




-20 20 


02 

4 

39 17 




d2 = 5“ 



1 /so 

A»+'/m 


Oo 

5** 

4“ 30* 






-20“ 26* 


Oi 

4 

44 4 


-9* 




-20 35 


02 

4 

23 29 
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Hence 

A‘*Vo« — 

A‘^7oo ■= A®^V,o 
A^-Voo — A^^'/o. 

A‘-Y„o = A»*V,o 
A»^7oo = A'^o/oi 

A"*2/oo — A^^o/oa 

48“ 

A“-»/oo — 0, 

A®*Yoo “ 0. 

We have already found in Example 1 that 

u = 0.6, V = 0.5. 

Substituting in (X) these values of u, v, and the computed differences, 
we get 

/(12° 16°) = + 0.6 (— + 0.5 (— 20“26*) 

+ i[0.6(— 0.4)(— 17“) +0.6(7") + 0.5(— 0.5)(4»)] 

+ i[0.6(— 0.4) (— 1.4) (— 18") + 0.9 (— 0.4) (— 14") 

+ 0.9(— 0.5)(— 5") +0] 

+ gJjLO + 1.2(— 0.4)(— 1 .4)(— 3") + 1 .8 (— 0.4)(— 0.5)(— 3") 

+ 0 + 0 ], 

or /(12°, 16°) == 5*‘15"’50'', as previously found. 

Example Jf. Solve Example 2 by means of formula (X). 

Solution. Since (X) is not a central-difference formula, we do not use 
the same function table as in Example 2. Erom the definition of the 
two-way differences A’"*"2,io it will he seen that the following triangular 
function table, starting from E’(62°, 67°), is all that is required for finding 
all differences up to the fourth order inclusive. 


0 

0 = 62° 

63° 

64° 

65° 

66° 

67° 

1 4220753 

1 4302236 

1 4384298 

1 4466803 

1.4549598 

68 

1 4522494 

1.4609635 

1 . 4697532 

1.4786046 


69 

1 . 4828589 

1.4921728 

1 5015826 



70 

1 5139061 

1.5238552 




71 

1.5453920 






— Ai'o/oo = — 16'"2" — (— 15"'9") = 7", 

— A®"7o„ 1" — (4“) 5", 

— A*^7o„ 31" — (— 17") 14", 

— A“*"/oo = 0 — 0 = 0, 

A»*7oo 21" — (— 18") 3", 

— 2A2*»/„, + A^^o/oo 

— 2(— 31") + (— 17") 3", 
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The following difference tables are next computed: 


5o = 62° 



F qi4> 

AO-^*Fo0 

AO+*Fo0 


A»+*n^ 

00 

1 4220753 

301741 

1 



01 

1 4522494 

306095 

4354 

1 

23 


02 

1 4828589 

310472 

4377 

10 

-13 

0J 

1 5139061 

314859 

4387 



04 

1.5453920 









F,4, 


A®-^F,0 


00 

1.4302236 

307399 



01 

1.4609635 

312093 

4694 

37 

02 

1 4921728 

316824 

4731 


0> 

1.5238552 








F 20 



00 

1 4384298 

313234 



01 

1 4697532 

318294 

5060 


02 

1.5015826 
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P'eo 


A^^Feo 


A*«F«o 

Oo 

1 4220753 

81483 




Si 

1 4302236 

82062 

579 

-146 


dt 

1 . 4384298 

82505 

433 

-143 

3 

Oi 

1 4466803 

82795 

290 



e* 

1 4549598 






<^, = 68 ” 



Fei 

A>+»F«1 

^^^Fe^ 

A3+o/^^^1 

^0 

1.4522494 

87141 

\ 


Bi 

1 4609635 

87897 

756 

-139 

Bi 

1 4697532 

88514 

617 


B, 

1.4786046 


i 



4'2 = 69 '’ 



Fe2 

^^^Fd2 

A2+»F(I2 

Bo 

1 4828589 

93139 


Bi 

1.4921728 

94098 

959 

Bt 

1.5015826 




Hence 

— A"*® Foo = 87141 — 81483 = 5658, 
A^*^Foo ■= A®**^\o — ^°*^Foo = 4694 — 4354 = 340, 

= A='^®Foi — A""®Foo = 756 — 579 = 177, 

A^^oFoo -= A®*®^’,o — A®*»/?’oo =- 37 — 23 = 14, 

= A>*®Fo, — A®*®Fo„ ] 39 — (— 146) = 7, 

A='*='i?’oo ■»= A’'*®i?’o2 — 2A‘'*®^’oi + A='+®J’„o = 959 — 1512 + 579 
~26. 
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In Example 2 we found u «= 0.02789, v = 0.38014. Substituting in (X) 
these values of u, v, and the computed differences, we get 

1?’(62.°02789, 67.°38014) = 1.4220753 + 0.02789(81483) + 0.38014(301741) 
+ K0.02789(— 0.97211)(579) + 2(0.02789)(0.38014)(5658) 

+ 0.38014(— O.C1986)(4354)] 

+ ^[(0.02789) (— 0.97211) (— 1.97211) (— 146) 

+ 3(0.02789) (— 0.97211) (0.38014) (177) 

+ 3(0.02789) (0.38014) (— 0.61986) (340) 

+ 0.38014(— 0.61986) (— 1.61986) (23] 

+ ^[0.02789(— 0.97211)(-- 1.97211)(— 2.97211)(3) 

+ 4(0.02789) (—0.97211) (—1.97211) (0.38014) (7) 

+ 6(0.02789) (— 0.97211) (0.38014) (— 0.61986) (26) 

+ 4(0.02789) (0.38014) (— 0.61986) (— 1.61986) (14) 

+ 0.38014(— 0.61986) (— 1.61986) (— 2.61986) (— 13)] 

= 1.43372 64. 

This value differs from that found in Example 2 by four units in the 
last decimal place; but in view of the fact that different parts of the 
function table, different formulas, and different methods were used in 
the two computations the agreement is as close as could be expected. 

Note. The two methods explained in this chapter are sufficient for the 
solution of all ordinary problems of double interpolation. As to which 
of these methods is preferable, it may be said that the use of formula (X) 
is probably shorter if all differences above the second are negligible. 

For a more extensive treatment of double interpolation the reader should 
consult Steffensen^s lnterj)olation, pp. 203-223, and Tracts for Computers 
No. Ill, Part II, by Karl Pearson. 

42. Trigonometric Interpolation. When the function we desire to 
represent by an interpolation formula is known to be periodic, it is better 
to use trigonometric interpolation. Hermite’s formula for interpolating 
periodic functions is 

sin(.r — .r,) s]n(j' — r.) -snM.r — .r„) 

^ ^ sin(.r., - .r, ) sin(j*o — -r-) • sin (,r„ — .r„) 

sin (.T — .r,, ) sin ( .r — .r . ) • sin ( r - - ) 

~ siii(j-, - - j„) sin (.ri — .r.. ) ■ siii(.)-, — 

sin(T — To) sin(.r — r, ) ■ siii(.r — Jn-i ) 
sm(x„ — lo) sin(a:„ — Xi) ■ ■ •sm(T„ — Xn-i)^”' 
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This function has the period 27r, as may be seen by replacing a; by a; + 

It is evident also that y =*= yo when x y yi when x =— Xj^, etc. 

This formula of Hermite’s for periodic functions corresponds to 
Lagrange’s formula for non-periodic functions (Art. 26), and applies 
whether the given values of x are equidistant or not. By interchanging 
X and y in Hermite’s formula we get a formula for the inverse interpola- 
tion of periodic functions, corresponding to (IX) of Art. 26. * 

Example. Given the following corresponding values of x and y, find 
the value of y corresponding to a; *= 0.6, the values of x being in radians: 


X 

0 4 

0 5 

0 7 

0.8 

y 

0 0977 

0 0088 

-0 1577 

-0 2192 


Solution. Here Xq = 0.4, Xy = 0.5, Xj = 
stituting these values in the formula 


= 0.7, X 3 = 0.8, x = 0.6. Sub- 


we get 


or 


Vo 


sin {x — Xi) sin (x — x^) sin (x — Xi) 
sin (Xo — Xi) sin (xo — Xa) sin (xq — Xg 

^ sin (x — Xo) sin (x— x^) sm (x — xO 

4 - 


sin (xi — Xo) sin (xi — Xg ) sm (xi — Xg ) 

sin (x — Xo) sin (x — x,) sin (x — Xg) 
sin (Xg — Xo) sin (Xg — Xi ) sin (xg — x., ) 

sin (x — Xo) sin (x — Xj) sin (x — Xg) 
sin (xg — Xo) sin (xg — ) sin (xg -- xJ 

sin ( 0 . 1 ) sin ( — 0 . 1 ) sin ( — 0 . 2 ) 
sin ( — 0.1) sin ( — 0.3) sin ( — 0.4) 

sin (0.2) sin ( — 0.1) sin ( — 0.2) 


Vi 


y2 




+ 


+ 


+ 


sin (0.1) sin ( — 0.2) sin ( — 0.3) 


(0.0977) 

(0.0088) 


sin (0.2) sin (0.1) sin ( — 0.2) 
sin (0.3) sin (0.2) sin ( — 0.1) 

sin (0.2) sin (0.1) sin ( — 0.1) 
sin (0,4) sin (0.3) sin (0.1) 


(—0.1577) 


(— 0.2192), 


= — 0.01684 + 0.00592 — 0.10601 + 0.037 
= — 0.07915. 


The computation in this problem is conveniently performed by logarithms, 
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the log sines being given directly in the Smithsonian Mathematical Tables^ 
Hyperbolic Functions, Table III. 

Note, The problem of trigonometric interpolation was first solved by 
Gauss,* who derived several formulas similar to Hermite’s. The formula 
usually called Gausses formula differs from Hermite^s only in having the 
factor ^ written in front of all the angles; thus, 8ini(x — Xq) etc. It is 
believed, however, that Hermite’s formula is simpler than any of the Gauss 
formulas. 

EXERCISES VI 

1 . Using the data of p]xample 1, Art. 39, find by two methods the hour 
angle of the sun when a = 12° and = 16°. 


Werke, Band III, pp. 206-327. 
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I. NUMERICAL DIFFERENTIATION 


43. Numerical Differentiation is the process of calculating the deriva- 
tives of a function by means of a set of given values of that function. The 
problem is solved by rej)resenting the function by an interpolation formula 
and then differentiating this formula as many times as desired. 

If the function is given by a table of values for equidistant values of the 
independent variable, it should be represented by an interpolation formula 
employing differences, such as Newton’s, Stirling’s, or Bessel’s. But if the 
given values of the function are not for equidistant values of the inde- 
pendent variable, we must represent the function by Lagrange's or Hermite’s 
formulas. 

The considerations governing the choice of a formula employing dif- 
ferences are the same as in the case of interpolation. That is, if we desire 
the derivative at a point near the he ginning of a set of tabular values, 
we use Newton’s formula (T). Whereas, if we desire the derivative at a 
point near the end of the table, we use Newton’s formula (IT). For points 
near the middle of the table we should use a central-difference formula — 
Stirling’s or Bessel’s. 

The values of derivatives in terms of differences may also be found by 
means of those interpolation formulas which einjiloy differences. Thus, 
from Stirling’s formula we have, since 

X — Xo dy dy du dy 

h dx du dx h du^ 

y. + . + f “’y-. + + 

— 1) u{u^ — 1) (u^ — 2~) A=t/.3 + 

+ 41 51 2" 



dy If Ay.i + Ayo , .2 , 

li-iXr T'- +“^v.+ 


+ — yt" + 

eu® — 20u® + Su 


3u^ — l 
3! 

5u* — 15^*^ + 4 


5! 


+ 


6 ! 


+ • 


]. 


2~ 

2 
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^ - pL'' »- + " + -in ^'»-= 

20^^ — 30u A'^^.a + A®y _2 30u* — 60u^ + 8 


A«y -3 + •••], 


<^*y ^ 1 r ^ Vz + A"y-i 

da;® ‘ A® L 2 

, 120w» — 120w . 


+ uA*y .2 + 


60«® — 30 A®y.., + A®i/.2 


^ == J_ 

da;* A* 


120w® — 120w,. , -1 

6l ‘^V. + - ■ - J, 


360^2 — 120 
' 6 ! 


A“y-3 +•••], 


<^°y L r A° y-3 + A°y-z 

A® L 2 

g-=^[^v.+ •■]. 



Evidently we can find the derivatives in exactly the same way by dif- 
ferentiating Newton^s, Bessel’s, and TaUgrange’s formulas. 

To find the maximum or minimum value of a tabulated function we 
compute the necessary differences from the given table, 'substitute them 
in the appropriate interpolation formula, put the first derivative of this 
formula equal to zero, and solve for u. Then x is found from the relation 
x = Xo-{- hu. 

We can also find the maximum or minimum value of a function by 
equating to zero the first derivative of Lagrange^s formula. 
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Example. Find the first and second derivatives of the function tabu- 
lated bclow^ at tlie point x = 0.6. 


X 

y 

Ay 

A’3/ 


A*y 

0 4 

1 5836494 

2137932 




0 5 

1 7974426 

2467950 

330018 

34710 


0 6 

2 0442376 

2832678 

364728 

38358 

3648 

0.7 

2 3275054 

3235764 

403086 



0.8 

2 6510818 






Solution. Here Xq = 0.6, u = 0, h = 0.1. Substituting in the formulas 
for the first and second derivatives at x Xq the aj)propriate differences 
from the table above, we get 


dx 


10[0.2650314 — 0.0006089] 


= 2.644225, 


dx- 


= 100 [0.0364728 — 0.0000304] == 3.644 24. 


The function tabulated above is 


Hence 


y = 2e^ — X — 1. 




Putting 2 : = 0.6 in these, we get 


^ = 2.644238, = 3.644238 

dx dx^ 


as the correct values for the fir.st and second^ derivatives. The values found 
by numerical differentiation are therefore cOrrec't to five significant figures 
in the case of the first derivative and to six significant figures in the case 
of the second derivative. 

Partial derivatives of a tabulated function of two independent variables 
can be found by differentiating partially formula (X) of Art. 41. 
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II. NUMERICAL INTEGRATION 

44. Introduction. Numerical integration is the process of computing 
the value of a definite integral from a set of numerical values of the 
integrand. When aj)plied to the integration of a function of a single 
variable, the process is sometimes called mecharUccil quadrature:, when 
applied to the computation of a double integral of a function of two 
independent variables it is called mechanical cuhature. 

The problem of numerical integration, like that of numerical differentia- 
tion, is solved by representing the integrand by an interpolation formula 
and then integrating this formula between the desired limits. Thus, to find 
the value of the definite integral ydx, we replace the function y by an 
interpolation formula, usually one involving differences, and then integrate 
this formula between the limits a and 6. Tn this way we can derive quadra- 
ture formulas for the approximate integration of any function for which 
numerical values are known. We shall now derive some of the simplest 
and most useful of the quadrature formulas. 

45. A General Quadrature Formula for Equidistant Ordinates. In 

Newton’s, Stirling’s, and Bessel’s interpolation formulas the relation con- 
necting X and u is 

( 1 ) x = Xo + hu, 

from -which we get 

(2) dx = hdu. 

Let us now integrate Newton’s formula (I) over 7i equidistant intervals 
of width h(—^x). The limits of integration for x are Xq and x^ uh. 
Hence from (1) the corresponding limits for u are 0 and n. We there- 
fore have 


1 ) l)(u—2) 

J ydx = hj^ I 3^0 + H 

, u(u - 1) (u — 2)(u — 3) , u(u — l)(u — 2) (u — 3)(z^ — 4) 

A yo H A t/o 


+ 


4! 

u(u — 1)(?^ — 

6l 


A®yo + • 


• ^ du. 


or 


(45. 1) j" ydx=^h ^ny^ + Ayo + ^ 3 - — y) ~ 


+ n^ + n 

Hf- 


/ 3 ! \ 5 2 


+ 


2 

lln’ 




3 

yo 


3n^ 




+ 


(t- 


15n« 


17n.*- 


225n^ . 274/1* 


■ 60/1' 
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From this general formula (45. 1), we can obtain a variety of quadra- 
ture formulas by putting n = l,2, • • •, etc. The best two are found by 
putting n = 2 and n == 6. 

46. Simpson’s Rule. Putting n = 2 in (45. 1) and neglecting all dif- 
ferences above the second^* we get 

ydx = h^ 2ijo -I- 2Ay„ + — 2 j — -J 

= h[2yo + 2i/i — 2yo + K2/2 — 2yi + yo)] 

= ^(yo + 4vi + y2). 

For the next two intervals from Xz to oTo + we get in like manner 


/. 


ir2+2/k 

ydj = - (y, 4- 4y., + y4) . 


Similarly for the third pair of intervals we have 


J 


' ^4 + 2 ^ 

y‘^^=r, {y* + 4^6 4- j/n) ; 

r4 


and so on. Adding all such expressions as these from to Xn, where n 
is even, we get 


J ' xo^nh Ji 

ydx = - ( y,, + ‘iy,+y. + y.,-\- 4y;, + y, + j,, + 42/5 + ya + 

J’n 'J 


■ • ■), 


or 


y<I-r = rAy>.<+-iyi+‘'iy2+iy2+‘^y4+ ■ ■ • +2y„-.+4y„_i+y„) 

= ^ ryo + 4(yi4-y3 + - • • + yn-i) +3(j/2 + y4 + - • • 


• • • + yn- 2 ) + yn]. 

h” 

O 0 

where c = 1, 4, 2, • ■ • 2, 4, 1. 

This important formula is known as Simpsons Rule, It is probably 
the most useful of all the formulas lor mechanical quadrature. 


* Since the interval of integration extends only from j?o to a?o -h 2/i, there are only 
the functional values j/o, j/i, 3 /, in this interval. Hence with only three values, there 
can be no differences higher than the second. 
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When using this formula the student must bear in mind that the 
interval of integration must be divided into an even number of sub- 
intervals of width h. 

The geometric significance of Simpson^s Rule is that we replace the graph 
of the given function by n/2 arcs of second-degree polynomials, or para- 
bolas with vertical axes. 


47. Weddle’s Rule. Putting n = 6 in (45. 1) and neglecting all dif- 
ferences above the sixth, we have 

X a?o+«fc f- 193 

ydx = 6yo + 18 Aj/o + 27A“«/o + 24A®i/o + A*yo 


+ S ] . 


10 


140 


Here the coefficient of A®i/o differs from 3/10 by the small fraction 1/140. 
Hence if we replace this coefficient by 3/10, we commit an error of only 

Y^A®yo. If the value of h is such that the sixth differences are small, 

the error committed will be negligible. We therefore change the last term 
to (3/10)A‘'yo and rejilace all differeiu'es by their values in terms of the 
given t/’s. The result reduces down to 


X 


*0+6* 3/l 

ydx = [yo + 5yx + y. 


by. 4 ^4 + T)!/, + 


For the next set of six inteivals from to Xio we get in the same way 



^ [ye + r)y7 + y8 + Oyy -f yio + •‘>yii + yiL']- 


Adding all such ex}H’es.sions as these from Xo to .r„, where n is now a 
multiple of six, we get 


XQ+nh ‘ih 

(47. 1) J ydx = [yo + + y^ + 6y , + y 4 + ^y^ + 2y^ -j- r>y, + y^ 

+ Oyo -|- yio -j- 5^x1 -j- 2yi2 -f- ' ' ' 

-\- 2yn_e -f- r)y„_R + yn -4 + Cyn-3 + yn-2 4“ ^y»-i 4" y«]- 


3h 

To' 


n 


'2ky, 


where k = 1, 5, 1, 6, 1, 5, 2, 5, 1, 6, 1, 5, 2, etc. 

This formula is known as Weddle s Rule. Ji is more accurate, in general, 
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than Simpson’s Rule, but it requires at least seven consecutive values of 
the function. 

The geometric meaning of Weddle's Rule is that we replace the graph 
of the given function by n/6 arcs of fifth-degree polynomials. 

We shall now apply these formulas to two examples, chosen at random. 

Example 1. Compute the value of the definite integral 


/. 


r 


In xdx. 


Solution, We divide the interval of integration into six equal parts each 
of width 0.2. Hence ^ = 0.2. The values of the function y = \nx are 
next computed for each point of subdivision. These values are given in the 
table below. 


X 

In X 

X 

In X 

4 0 

1.38629436 

4 8 

1 56861592 

4 2 

1 43508453 

5 0 

1 60943791 

4 4 

4 6 I 

j 

1 48160454 

1 52605630 

1 

5 2 

i 

1 64865863 


(a) By Simpson’s rule we have 

Is = ^[3.03495299 + 4(4.5?05rH74)+ 2(3.05022040)] = 1.82784726. 
o 

(b) By Weddle’s rule we get 

= (0.3) (0.2) [3.03495299 + 5(3.04452244) 

+ 3.0502204G + G ( 1 .52G05630) ] = 1.82784741. 
The true value of the integral is 

/ = ( “'"in 2 - dx = x(ln x 1 ) 1.82784741. 

4 -J 4 0 

Hence the errors are 

Ea = 0.00000015 == 15 X 10+ 

Ew = 0. 


Example 2. Compute the value of the definite integral 



SI FI X — In r + r’') dr. 
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Solution. We shall divide the interval of integration into twelve equal 
parts by taking h =^0.1. The values of the function y = sin x — In rr -f- e® 
are then computed for each point of subdivision. These values are given 
in the table below. 


X 

y 

X 

y 

0 2 

3 02951 

0 9 

3 34830 

0 3 

2 84936 

1 0 

3 55975 

0 4 

2 79754 

1 1 

3 80007 

0 5 

2 82130 

1 2 

4 06984 

0 6 

2 89759 

1 3 

4 37050 

0 7 

3 01465 

1 4 

j 4 70418 

0 8 

3 16605 

1 

1 

1 


(a) By Simpson’s rule: 

Ib=^ [3.02951 +4.: 0418 + 4(20.20418)+ 2(lo.490W)] = 4.().510(i. 

(b) By Weddle’s rule: 

/>r = 0.03[21.0r)841 + 5(1:1.:, 8^81 ) + G (b.G2137) + 2 (3.1GG05) j= 4.050fl 8. 
The true value of the integral is 

J .l 4 -114 

(sin j- — In .r + = — cos j - ^(Inj* — 1 ) + 

02 -J 0 2 

== 4.0501)5. 


Hence the errors are : 

is\y== — 0.00011, 

Kw == — 0.00003. 

It will be noted that Weddle's rule is more accurate than Simpson's in 
both examples. 

Although Weddle’s rule is simple in form and very accurate, it has the 
disadvantage of requiring that the number of subdivisions be a multiple 
of six. This means that when computing the values of y in many iiroblems 
the assigned values of x c an not be taken as simjile tenths, as was done in 
the two examples worked above. The subdivision by tenths is nearly always 
possible when using Simpson’s rule. However, when Simpson's rule can 
not give the desired degree of accuracy, Weddle’s rule sliould he used. 

When several values of the function arc given, as in the above examples, 



136 


NUMERICAL INTEGRATION 


[Chap. VII 


it is better to make the computation in tabular form, as shown below for 


Simpson^s rule in Ex. 1. 



X 

In X 

c 

c In a; 

4.0 

1.38629436 

1 

1.38629436 

4.2 

1.43508453 

4 

5.74033812 

4.4 

1.48160454 

2 

2.96320908 

4.6 

1.52605630 

4 

6.10422520 

4.8 

1.56861592 

2 

3.13723184 

5.0 

1.60943791 

4 

6.43775164 

5.2 

1.64865863 

1 

1.64865863 




27.41770887 X — = 1.82784726. 


The reader is cautioned against thinking of quadrature formulas as 
simply methods of computing areas under curves. These formulas are 
methods for computing the values of definite integrals. They give areas 
only when the integrands are the ordinates of a curve. The integrand may 
be any function of x, provided it is known for equidistant values of x. 
This fact is illustrated by the following example. 

Example S. Find by Simpson's Eu^e the coordinates of the centroid and 
the moment of inertia about the j-axis for the plane area shown below. 


Y 



Solution. The formulas for the centroid give 

_ Jo _ {h/3) (Xoyo + 4a-.y, + 2x,y, -f ■ • ) _ ^ 

* dA J“ y dx (V3)(yo + 4yi + 2y2 + • • ) Scy 

. J;fy/2)dA /g y^dx _ (h/3){y„^ + 4y.» + 2y/ + ■ ■ ■) _ S cy^ 

dA ® J® ydx * (h/3) (yo + 4yi + 2y2 + • • •) *5 cy 
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Since the moment of inertia of a rectangle about its base is bh^/3, the 
moment of inertia of the elementary area y dx about the a:-axis is ij^dx/S. 
Hence for the whole area we have 

h = 1/3 dx = 1/3 X ( V3)(t/o^ + + 2y^ + - •) = {h/9) Xcy\ 

The computation form for this example is therefore as shown below: 


X 

y 

xy 

y‘ 

y"' 

C 

cy 

cxy 

cy- 

cy' 

Xq 

Vo 

xoyo 


yo 

1 

2/o 

XoVo 

2/o‘ 

yo' 

Xi 

2/1 

Xiyi 


yi^ 

4 

42/i 

4j,?/i 

4yi= 


X2 

2/2 

x>y2 

y-i- 

y-^ 

2 


2x,ij, 


2y./ 

Xa 

2/3 

Xay3 


y-^ 

4 

4«/3 

4^3?/:. 

42^3=-’ 

iyv' 







8, 

8, 

8, 

8, 


Hence 

x = S,/S„ /,= (V9)^., 

where the S's denote the sums of the nundiers in the columns above them. 

Any other exiiniple can be handled in a similar manner after it has been 
set up as a definite integral. 

Note 1. By putting n = 1 in (45. 1 ) and neglect- 
ing all differences above the first, we can derive a 
simple but crude formula known as the Trapezoidal 
Rule. This formula replaces a curve by a series of 
chords. For small values of h it will give fair results, 
but it is inherently too inaccurate for general use. 

For this reason it is not considered in this book. 

y<)lc 2, A quadrature formula derived from an 
algebraic ])olynomial will not give a reliable result in 
regions vvdiere the graph of the given function is verti- 
cal, be( ause an algtdiraic jiolynomial is never vertical 
and therefore cannot be made to coincide with a verti- 
cal segment of a curve. A simple and satisfactory way 
of handling siK'h a case is to re])lace the curve in the 
vertical region by a parabola having a horizontal axis. 

Thus, for the curve shown in Fig. 3 we replace the arc 
Mr by an arc of the parabola == 2/^.r. Then the 
area of the segment MPN is (2/3)xiyi. 

48. Central-Difference Quadrature Formulas. By integrating Stirling's 
and BesseFs interpolation formulas we can derive rapidly converging quadra- 
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ture formulas in terms of differences. Thus, integrating Stirling's formula 
from X = Xo — h to x == Xq h, or n = — 1 to u = \, we have 


-i 

^ <^>(i)dx === hj' ^ (yo + 


Ayo 

+ — 
^ 2 

1 

<I 

1 

u{u^ — 

1) A"y-2 + A“y_, 

u^(u^- 

-1) 




sT 

2 

4! 


^ V -: 

2 

+ 

u{u'^ — 

1) (u^ — 4) A‘’y_3 
5! 

+ A®y-2 

2 




+ 

u^{u^ — 


4 ...) 

du 




^^0 + 

3 ^‘^24 Vs 

-5)av 

2 + 

— ( 

720 \ 

;-i-i4-|)av.] 

= 2h 

[ 3/0 + 


2+ ^ 

^ 1512 

A«2/. 

-3 + * 



This formula gives the approximate value of the integral from x = Xq — h 
to X = Xo h . By advancing the subscripts of the y’s by one unit we get 
the value of the integral from x = Xq to x = Xq 2h, Denoting this 
integral by Iq^, we have 

= 2h [y. + ^ A‘y., + ^ A"y., ] . 


The integrals h*, 1 4 ^, • ■ • I \-2 are likewise seen to be 

/.• - 2* [ ,. 4 A-,,] , 

/.• - 2* [ 4- I A=,. - ^ A-,, 4 A-,,] , 


Adding all these separate integrals, we get 

(48. 1) 7o" = 2A j^y, 4- 3/3 + y« + • ' + 3/»-i 


15^12 


+ i (A^o + A^y. + • • • + A*y„-3) 

D 

~iio + • • • + A‘y»-8) 

+ Y5J2 + ■ ■ ■ + A'y...) J , 
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where 



and n is even. 


Integrating Bessel’s formula (VI) over the interval x — x^io x — h, 
or v = — i to v = we have 




(v‘ — i) A==y.i + A^yo 


v(v'' — i) ^ — -I) AV, + A’y, 


3! 


4! 




5! 


A'y-a 


— i){v^ — l)(^^ — V ) A°y_3 + A“y, 


6 ! 


+ • 


^dv 


A ryp + y- _ L A^y-. + A^^yo . 

^ L 2 12 2 

_ 191 A°y,3 4- A°y,n 

60480 2 J ■ 


11 A*y.3 4- A^y., 

720 2 


By advancing the subscripts a unit at a time we find the integrals over 
the succeeding intervals to be 

A 2 _ L r _ i _L Ji_ 

' L 2 12 2 "^ 720 2 

_ A Vo + ^Vi "! 

()0480 2 J ’ 

r 3 _ 7, r __ JL , jj_ av + A* y, 

" L 2 12 2 "^ 720 2 

_ 191 AVLt^n 

60480 2 J ^ 


An 7, r y^-'^ + y^ _ -l ^ i _LL ^"y»-3-+ A^y,,., 

L 2 12“’ 2 720 2 

_ 191 av. 4 + AV _3n 

60480 2 J * 


Adding all these separate integrals, we get 
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(48. 2) 


h" = h j^(^- + J/i + 2/2 + ■ ■ + 2/>i-i + 

+ A=,„. + ^--l) 

+ + ■ ■ ■ 

+ 


H>1 / AV, 
(i04<S() \ 2 


AV2 + A'-v,, + 


+ A'’i/„_^ 



where re is now either even or odd. 

It will be observed that formulas (48.1) and (48.2) involve only 
differences of even orders, that (48. 2) involves all the even differences, 
whereas (48. 1) involves only half of them. Formula (48. 2) is too 
cumbersome for practical use as it stand.s. but it can be transformed into 
a much simpler and more useful form, as we shall now show. 

From the definition of differences we have 


AVi = Ayo — Ay.,, 
A-y„ = Ay, — Ay„, 


A-'y„., = Ay„ — Ay„_„ 
A^y.j = A^y,, — A^y.,, 
A^/_i == A'’y„ — AY„ 

A‘y„-2 = A^y„.i — A“y„_2, 
A«y-3 = A®y.2 — A'y_3, 

A®y _2 = A'‘y-i — A'y.^, 


A®y„-3 = A"'y„_3 — A®y„-a, etc. 

Substituting in (48. 2) the.se values of the even differences, we find that 
all differences e.xcept those at the beginning and end of the table cancel 
one another and that formula (48. 2) reduces down to 
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/o" — A 


[( 


^ + 3/2 + • • • + Vn-I + ^ 


)+i(^s=^) 


11 ( A Y2 + A Yi \ 

720 V 2 / 


60480 


^ A°y,3 4- 

_ -i / Ayn_i 4- Ay, \ ■ 11 / A°yn.2 + A»y„,i \ 
12 V 2 /'^ 720 \ 2 / 


191 


^ ^°yn,3 + A°yn J 


60480 \ 2 

which can be written in the simpler form 

(48.3) 7o» = /i 


2 + 3/1 + 3^2 + • ■ • + 3/n-i + 


) 


+ Ay» Ay-, + Ay. 


-) 


_ ^ /Ayn-l 

12 V 2 2 

11 / A°yn-2 + A^yn-i _ A^g + A^A 

720 \ 2 2 / 

,-3 + A»yn-2 _ A’>y,3 + A=^y.; \ 

2 /■ 


+ 


191 

60480 




The results given by this formula are identical with those given by 
(48. 2), but tlie labor involved in obtaining them is only a small fraction 
of that required when using (48.2). 

The geometric signiticaime of formulas (48.1), (48.2), and (48.3) 
should be noted. Formula (48. 1) replaces the graph of the given func- 
tion by n/2 arcs of polynomials of the sixth degree, whereas (48. 2) and 
(48. 3) replace the graph by n arcs of sixth-degree polynomials. 

By neglecting fourth and sixth differences in (48. 1) and replacing the 
second differences by their values in terms of the y’s, we shall find that 
(48. 1) then reduces to Simpson’s Rule. This formula therefore represents 
Simpson’s Rule with correction terms. 

We shall now apply (48. 1) and (48. 3) to two examples. 

Example 1. Compute the value of -tt from the formula 

TT dx 

4“ Jcr l + x^ 

Solution. We first compute the values of the function y 1/(1 -j- x^) 
from x = — 0.3 to a: = 1.3, taking h = Q.ly and then form a table of 
difference as shown on the following page. 
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Substituting in (48. 1) the appropriate differences, we have 

^ -= 0.2[3.9311573 + | (- 249992) - ^ (- 7) + i^(778)] 
= 0.78539816. 

TT = 4 X 0.78539816 = 3.14159264. 

The true value of tt to nine figures is 

TT = 3.14159265. 


Difference T^ble for t/* l/(l+x*.) 


X 

y 

Ay 

A^y 

A*y 

A*y 

A^y 

A^y 

-0 3 

0.9174312 

441073 






-0.2 

0.9615385 

285605 

-155468 

-31127 




-0.1 

0 9900990 

99010 

-186595 

-11425 

+ 19702 

+3148 


0 

1 0000000 

- 99010 

- 198020 

+ 11425 

+22850 

-3148 

-6296 

0 1 

0 9900990 

-285605 

-186595 

+31127 

19702 

-7910 

-4762 

0 2 

0 9615385 

-441073 

-155468 

42919 

11792 

-9230 

-1320 

0 3 

0 9174312 

-553622 

-112549 

45481 

2562 

-7344 

+ 1886 

0.4 

0.8620690 

-620690 

- 67068 

40699 

- 4782 

-4021 

+3323 

0 5 

0 8000000 

-647059 

- 26369 

31896 

- 8803 

- 936 

3085 

0 6 

0 7352941 

-641532 

+ 5527 

22157 

- 9739 

+ 1047 

1983 

0.7 

0 6711409 

-613848 

-h 27684 

13465 

- 8692 

+ 1915 

868 

0.8 

0 6097561 

-572699 

41149 

*6688 

- 6777 

2001 

86 

0.9 

0 5524862 

-524862 

47837 

1912 

- 4776 

1702 

- 299 

1.0 

0 5000000 

-475113 

49749 

- 1162 

- 3074 

1286 

- 416 

1.1 

0 4524887 

-426526 

48587 

- 2950 

- 1788 



1.2 

0 4098361 

-380889 

45637 





1.3 

0 3717472 
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Substituting in (48. 3) the appropriate differences from the table, we 
get 

^ = 0.1 [7.8498150 — i(- 499988) + (375) 

191 

7r = 4 X 0.78539817 = 3.14159268. 

This value is slightly less accurate than that obtained by (48. 1), but 
either result is correct to as many figures as were used in the computed 
ordinates. 

Simpson’s Rule gives for this problem the value 

TT = 3.14159260, 

which is likewise correct to as many figures as are given in the computed 
ordinates. 

Example 2, Compute the approximate value of the integral 



Solution, Taking ^ = 0.1, we compute the values of y = l/x at one- 
tenth unit intervals from a: =*= 0.7 to a; =» 2.3 and form a table of differences. 

Substituting in (48. 1) the appropriate differences, we get 

I = 0.2 [3.45953943 + i (3727034) — (281353) 

D 180 

+ tAtt (61266)] = 0.693147185. 

1512 ' 

The correct value is In 2 = 0.693147181. 

Substituting in (48. 3) the appropriate differences from the table, we 
get 

I = 0.1 [6.93771403 — (7594744) + ~ (593339) 

12 7 2 U 

1 91 

— r r -- (136810)1 = 0.69314714. 

It will be seen that formula (48. 1) gave the more accurate value in 
this example as was the case in the preceding. 

Concerning the relative merits of formulas (48.1) and 48.3), it may 
be said that (48. 1) converges more rapidly and is therefore slightly more 
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accurate. It utilitizes fewer ordinates outside the range of integration 
than does (48.3). Formula (48.1) requires that the number of sub- 


DiflFercnce Table for y=\/x. 


X 

y 

Ay 

A^y 

A^y 

^*y 

Ahj 

Ahj 

0 7 

1 42857143 


17857143 






0 8 

1.25000000 


13888889 

3968254 

-1190476 




0.9 

1 iiiinii 


11111111 

2777778 

- 757576 

432900 

-180375 


1 0 

1 00000000 


9090909 

2020202 

1 

- 505051 

252525 

- 97123 

83252 

1 1 

0 90909091 


7575758 

1515151 

- 349649 , 

155402 

- 55505 

41618 

1.2 

0 83333333 


6410256 

1165502 

- 249752 

99897 

- 33293 

22212 

1.3 

0 76923077 


5494506 

915750 

- 183148 

66604 

- 20821 

12472 

1.4 

0 71428571 


4761904 

752602 

- 137365 

45783 

- 13459 

7362 

1.5 

0.66666667 


4166667 

595237 

- 105041 

32324 

- 8981 

4478 

1.6 

0 62500000 

1 


3676471 

490196 

- 81698 

23343 

- 6147 

2834 

1 7 

0.58823529 


3267973 

408498 

- 64502 

17196 

- 4292 

1855 

1.8 

0 55555556 


2923977 

343996 

- 51598 

12904 

- 3077 

1215 

1.9 

0 52631579 


2631579 

292398 

- 41771 

9827 

- 2234 

843 

2 0 

0 50000000 


2380952 

250627 

- 34178 

7593 

- 1045 

589 

2 1 

0 47619048 


2164503 

216449 

- 28230 

5948 



2 2 

0.45454545 


1976284 

188219 





2 3 

0 43478261 









intervals be even, and also requires a little more labor in its application 
than does (48. 3). 

Formula (48.3) has the advantage of being applicable to any number 
of Bubintervals and of requiring very little labor in its application. It 
also gives the same degree of accuracy with third or fifth differences as 
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(48. 1) gives with fourth or sixth diiferences. Its chief disadvantage is 
that it utilizes several ordinates outside tli(‘ range of integration. 

The extra-interval ordinates required in formulas (48. 1) and (48. 3) 
can usually be found by computation, as in tlie examples worked above, 
or by extrapolation by means of Newton’s formulas (I) and (IT). Usually, 
however, it is not safe to use extrapolation for finding more than one 
ordinate at each end of the range. 

49. Gauss’s Quadrature Formula. The most accurate of the quadra- 
ture formulas in ordinary use is known as Gauss’s formula. In Simpson’s 
and Weddle’s formulas the ordinates arc equally spaced, but it occurred 
to Gauss that some other spacing might give a better result. Hence he 
set for himself this problem: 

If the definite integral fj'f(x)(lx is to be computed from a given number 
of values of f{x), just where should these values be taken in order to get 
a result of the greatest possible accuracy? In other words, how shall the 
interval (a, &) be subdivided so as to give the best possible result? 

It turns out that the points of subdivision should not be equidistant, 
but they arc symmetrically placed with respect to the midpoint of the 
interval of integration. 

Let I = Qydx denote the integral fo be computed, where y = f{x). 
On changing the variable by the substitution 

( 1 ) {h — a)u+ , 

the limits of integration become — ^ and J. The new value of y is 

y = f{x) =fl{b — a)u + - y ^ ] =<t>{u), say. 


Then since dx = {b — a)dii, the integral becomes 

( 2 ) /=(& — <b{u)du. 

Gauss’s formula is 

(49. 1)7 = ^ (l>{u)du = 77^</)(i/io) -[- A^3 (^(w3) 

where Ui, the points of subdivision of the interval u = — ^ 

to u = The corresponding values of x are therefore 


=* (6 — a)ui 


a -f- h 


X2= {b — a)u2 + 


a + 6 


etc. 


2 
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The value of the integral is therefore 

(49. 2) / = J" f(x)dx = (h — a)[Ri<t>(u,) + R 24 >{u 2 ) + • * * + Rn<l>(un)'\- 

We shall not give a detailed derivation of Gauss’s formula (49. 1), but 
merely show how the values of Ui, and R^^ R 2 , ’ ' ' Rn are found 

and then show how to apply it to an example. 

We assume that 4>(u) can Be expanded in a convergent power series 
in the interval u = — ^ to u = Hence we write 

(3) <l>(u) =* flo + + * • * + + • • • . 

We also assume that the integral can be expressed as a linear function of 
the ordinates of the form (49. 1). Integrating (3) between the limits 
— ^ and we have 

(4) I = <f>(u)du = ^ aiu + ‘ ‘ • ‘)du 

From (3) we also have 

</)(wi) “ ao + fliWi + a2Ui^ + ttaWi® + + ■ ■ • + + • • * , 

*= CLq -(- OL1U2 -|- ^ 2 ^ 2 ^ “h ^ 3 ^ 2 ® “h “h ’ ’ ’ “ 1 “ 


<f>(Un) = ao + a^Un + a2Un^ + aaWn® + • • • + CimUn^ + ' * ' ■ 

Substituting in (49.1) these values of </>(ui), <^('^< 2 ), • • ' <f>(un), we get 

I = R^{ao + aiWi + + • * ' + + ' * 0 

R-ii^do -)“ Ui'U 2 -j- 0 - 2 ^ 2 ^ “f" ’ ■ ' “l~ dm,U^ H" ■ ■ ') 

-(- Rn{(lQ diUn -|- (l2ym^ ”1” , “}“ * ‘ ')> 

or, rearranging, 

(5) I = ao{Ri R 2 “4“ “h * * ’ + Rn) 

+ ai{RiUi + R 2 U 2 + * ■ * + Rn'dn) 

-j- "i" R2'd2^ RfiUn^^ 


+ OmiRiW,^ + + • • • + Rntln”^) 
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Now if the integral / in (5) is to be identically the same as the I in 
(4) for all values of Uq, ai, etc.; that is, if (5) is to be identical with 
(4) regardless of the form of the function then corresponding 

coefficients of ao, ai, a 2 , etc. in (5) and (4) must be equal. Hence we 
must have 


(49. 3) 4 


/?l -|- -^2 + -^8 + • * + 1 ; 

RiUi -j- R 2 U 2 -f“ "f" * ' ‘ “i“ ^n'^n ** 0, 

RiUi^ -j- “1“ ■Ra'Wa* ”!“**■"[■ 

RlUl^ “j“ ~f“ Rs'^3,^ “1“ ■ ‘ ' “1“ Rn'^n^ “ 9, 

R^Ui* + R2U2^ + R^u^^ 4 - • • . 4 - R^Un* =* , 


By taking 2n of these equations and solving them simultaneously, it 
would be theoretically possible to find the 2n quantities'll, ^ 2 , ' ‘ * Ww and 
Riy R 2 , ' • • Rn- However, the labor of solving these equations by the 
ordinary methods of algebra would be quite prohibitive even for small 
values of n. Fortunately a formula from higher mathematics makes such 
labor unnecessary. 

It can be shown * without difficulty that if <l>{u) is a polynomial of 
degree not higher than 2n — 1, then lii, W 2 , * * ' are the zeros of the 
Legendre polynomial Pn{u)j or the roots of Pn(u) “0. These roots are 
conveniently found from the equation 

( 6 ) 

The n roots Ui, U 2 ,' • ’ of this nth-degree equation are all real. On 
substituting them in (49. 3), we can find the i2’s. We shall do this for 
the case n = 3. 

The equation to be solved is 

IJi- [w* - “ 0’ ^ — (i)') - 0- 

Performing the differentiations and simplifying, we get 
u{20u^ — 3) *= 0, from which 
n * 0, rb ^ V3/5. 

Hence 

u, ^2 = 0 , 

* See, for example, Todhunter’s Functions of Laplace^ Lafn6^ and Bessel, p. 99. 
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Then from the first three of equations (49. 3), we have 

Ri -j- R 2 -f“ R^ = 1 

^i(— iVW -h =0 

7 .^(— y + R.iiy'^ )^ = i/i2. 

Solving these equations;, we find 

77 , = 0 / 18 , 770 = 4 / 9 , 773 = 5 / 18 . 

It is to be noted that the 7^’s are symmetrically placed with respect to 
the midpoint of the interval of integration and that the 77^s are the same 
for each symmetric })air of 7 /s. Hence from now on the u’s of the points 
of division will be designated by for the midpoint, for the pair of 
symmetric points nearest tlie midpoint, u ^2 for the next pair of symmetric 
points, etc. 

The numerical values of the i/’s and corresponding 77 ’b for n = 2 to 
== 10 are given in the ta])l(‘ below, where the notation of the form 
= X means Uj, = A/ v h = - ^ A\ 



u 

R 

n = 2. 

a,, = 0.2886751346 

R=\ 

71 = 3. 

7lo = 0 

if 


= 0.3872983346 

= 5/18 

II 

= 0.16999052J8 

R = 0.32G0725774 


= 0.4305681558 

E = 0.1739374220 

71 = 0 . 

7l{^ == 0 

R = 64/225 


71., = 0.2692346551 

R = 0.2393143352 


= 0.4530899230 

i? = 0.1184634425 

n = G. 

u,, = 0.1193095930 

R = 0.2339569673 


= 0.3306046932 

/;== 0.1803807865 


7L., = 0.4662347571 

A' = 0.08566224619 

n = 7. 

W(, = 0 

R = 0.2089795918 


u.i = 0.2029225757 

A' = 0.1909150253 


u,, = 0.3707655928 

A = 0.1398526957 


= 0.4745539562 

R = 0.06474248308 



Abt. 49] GAUSS’S FORMULA 149 



u 

R 

n = 8. 

0.0917173212 

72 = 0.1813418917 


u._2 = 0.2627662050 

72 = 0.1568533229 


w,3 0.3983332387 

72 = 0.1111905172 


« 0.4801449282 

72 = 0.05061426815 

n == 9. 

o 

1 

o 

72 = 0.1651196775 


=-0.1621267117 

7^ = 0.1561735385 


u._2 = 0.3066857164 

72 = 0.1303053482 


= 0.4180155537 

R = 0.09032408035 


0.4840801198 

72 = 0.04063719418 

n =» 10. 

= 0.0744371695 

72 = 0.1477621124 


= 0.2166976971 

72 = 0.1346333597 


= 0.3397047841 

72 = 0.1095431813 


tA,4 = 0,4325316833 

7^ = 0.07472567458 


w,5 = 0.4869532643 

A’ = 0.03333567215 

Note. For further tables relating to Gauss’s quadrature formula the 
reader should consult the following literatuie : 

1. Table of the Zeros of the Ix*gendre Ihdynomials of Order 1-16 and 

the Weight Coefficients for Gauss’s Mechanical Quadrature Formula/’ by 
A. N. Lowan, Norman Davids, and Arthur Levinson. Bulletin of The 
American Mathematical Society, Vol. 48, No. 10, pp. 739-743, October 


1942. 

This is the most extensive table of the zeros and Gauss coefficients that 
has yet been published. All numbers are given to 15 decimal places. This 
table gives the subdivision points for the interval u = — 1 to -u = 1, and 
the values of u and R must be divided by 2 to agree with those given in 
the table above. 

2. Valeur Approximative d'une Integrale Befinie, by B. V. Moors, Paris, 
1905. This is the most comprehensive work on approximate quadrature 
that has ever been written. The roots and ooefficients for the Gauss formula 
are given for n = 1 to n = 10 to 16 decimal places. The complete fo/ mula 
and its graphic representation are also given for each value of n. 

We shall now apply Gauss’s formula to a simple example. 
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7 - 

a/5 X 

Solution, Here we put 

X = (b — a)u -[- ^ ^ = 7w + 8.5 

^ “ 7 “ 7u + 8.5 = 


[Chap. VII 


Taking n — 5, we have 


yo -f‘<f>{Uo) == — = 0.117647059 
0.5 


yi-=<t>{u,) = 


1 

1 , 

~ 7mx + 8.5 

10.3846426 

1 

1 

__ 1 

7u.^ + 8.5 

6.61535741 

1 

1 

7«i2 + 8.5 

11.67162946 

1 

__ 1 

' 7t4.2 + 8.5 

5.32837054 


0.0962960439 


Substituting these values in (49.2), together with the corresponding 
fl’s for n «= 5, we get 

/ _ 7[ ^ X 0.117647059 + 0.2393143352(0.151163412 + 0.0962960439) 
22o 

+ 0.1184634425(0.187674636 + 0.0856778399)], or 
lo = 0.875468458. 

The true value of the integral is 

dx ,12 , „ . „ 


J s X 5 

The error is therefore 


In 2.4 = 0.875468737. 


Eo = 0.00000028. 

The value of this integral by Simpson’s Rule, using fifteen ordinates, is 

7s — 0.87547189. 

The error in this case is therefore 


Eg = 0.0000034, 
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or more than ten times as great as with Gauss’s formula. The labor 
required to find the integral by Gauss’s formula is, however, many times 
as great as with Simpson’s unless a computing machine is used. 


Note. The distance in a:-unit8 of any point Ux from the midpoint of 
the interval of integration is (6 — a)ui. 

To prove this, let h — a = L and take the midpoint of the interval as 
origin of coordinates. Then the limits of integration for x are — L/2 
and L/2. On substituting — L/2 for a and L/2 for b in the trans- 
formation formula x= {b — a)u -}- ^ ^ we get 


Lu ■■ 


2 

{b — a)u 


Gauss’s formula is useful for another purpose besides computing definite 
integrals. Recalling that the mean value of a function is given by the 
formula 


Vm 



y 


we see that the accuracy of the mean depends on the accuracy with which 
the integral j^ydx can be computed. The most accurate value of this is 
obtained by measuring ordinates at the points given by Gauss’s formula. 

Thus, if we wished to find the best value for the mean daily tempera- 
ture from only four measurements, we would proceed as follows: 

Denoting temperature by T, the hour of the day by and taking noon 
as the middle of the day, we have 


r = /(0, 



Taking noon as the midpoint of the 24-hour period and remembering 
that the time measured from noon is 24m, we have for n = 4, 

tx = 24ui = 24(0.16999) == 4.‘‘0798 = 4>' 4.'”8 

U = 24u-i = 24 (— 0.16999) 4*' 4.'«8 

<2 = 24u 2 = 24(0.430568) = 10.'>3336 = ibh 20™ 

U = 24m_ 2 = 24 (— 0.430568) lO^* 20™. 

The best times during the day to take measurements are therefore 
1 :40 A.M., 7:55 a.m., 4:05 p.m., and 10:20 P.M. 
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In a similar manner we could find the best times of the day for making 
five, six, or any other number of measurements by taking the proper u’b 
for n = 5, 6, etc. 

The same method can be applied for finding the best positions or times 
for taking measurements on any other physical quantity. 

Remarks. 1. The reader should bear in mind that Gauss’s formula gives 
an exact result when f(x) is a j)olynomial of the {2n — l)th degree or lower. 

2. Although Gauss’s method is theoretically beautiful and of great 
accuracy, it has the disadvantage of being laborious in its application, for 
three reasons : 

(a) If the limits of th(‘ given integral are not — ^ and the integral 
must be transformed to one that has these limits. The transformed integral 
is usually more eomplicat('d than the given one. 

(b) If the values of y are to be computed from a formula, the numerical 
values of u to be substituted in the formula must be given to at least as 
many significant figures as we wish to obtain in the y’s. 

(c) After we have found the y's to the desired number of significant 
figures we must multiply them by 7^’s having at least as many figures. 

Gauss’s formula thus compels us tc deal with large numbers in every 
step if we desire the accuracy it is capable of giving. In applying this 
formula it is therefore imperative that we use every available aid for 
reducing the labor of computation. Whoever doubts this statement has 
only to work out a simple example to be convinced. 

3. Gauss’s formula should be used for computing definite integrals only 
when few ordinates are obtainable or when the importance of the result is 
such as to justify a great expenditure of labor. 

50. Lobatto’s Formula. The reader will have noticed that Gauss’s 
formula does not contain the values of the function at the end points of 
the interval of integration. In certain types of problems it is highly 
advantageous to utilize the end values of the function. Lobatto * therefore 
modified Gauss’s formula so as to include the end values and also the value 
of the function at the midpoint of the interval. The modification con- 
sisted in finding the points of subdivision (including the midpoint and 
the end points of the interval) from the equation 

( 1 ) 

where n denotes the total number of values of the function to be utilized 

* Lessen over de Integraal-Rekening j §207-210. The Hague, 1852. 
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(including end values and midpoint values). The values of u found from 
this equation are then substituted in equations (49. 3) to find the corre- 
sponding i2’s. We shall derive Lobatto’s formula for the case n =- 5. 

When n = 5, (1) becomes 

or 

On performing the indicated differentiations and simplifying, we get 


~ 40^2 -f 3) =0, 

from which 

u = 0, it: 3/7, db -J. 

Hence 

Ui == Un = ^ \/ 3/7 , i^3 = 0, U 4 = ^ 's/ 3/ i , Us = 


On substituting these values of u in the first five of equations (49. 3) and 
solving for the 7v*’s, we find 

= ]/*.>0, R, = i?4 = 49/180, Rs = 16/45. 

Hence Lohaito^s formula for n==r) is 

/=(?,_«,) Q® (y-i + 2/0+^ + 3 / 2 ) J . 

The values of ti and R for several values of n are as follows : 


u 

n = 3. 

Uo = 0 

u^i == i 

n = 5. 

Uo 0 

i V 377 -= 0.327327 
u._n==i = 0.5 

n=«7. 

Uo = 0 

0.2344245 
U.2 = 0.415112 
w,8 “ 0.5 


R 


i? = 2/3 
R = 1/6 

R = 16/45 = 0.355556 
= 49/180 = 0.272222 
== 1/20 = 0.05 


72 = 0.2433097 
72 = 0.2158727 
72 = 0.1384129 
72 = 0.02380951 
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o 

1 

o 

B = 0.1857593 

=0.1815585 

B = 0.1732142 

= 0.338593 

B = 0.1372695 

tUi = 0.449879 

B = 0.08274774 

= 0.5 

B = 0.0138888 

lio = 0 

5 = 0.1501037 

= 0.147876 

B = 0.1434397 

u^2 = 0.282617 

B = 0.1240270 

= 0.392242 

B = 0.09358390 

= 0.467000 

B = 0.05480614 

Uts 0.5 

5 = 0.009091366 


These values are to be substituted in formula (49. 2). 

Lobatto^s formula is less accurate than Gauss’s for the same but it is 
frequently more convenient for use. If the function happens to be zero 
at the ends of the interval of integration, as is frequently the case, the 
end values do not have to be computed. The computation is thereby 
shortened. 


Example, Compute by Lobatto’s formula the value of the integral 


for n =» 5. 


6 ^ 


Solution. The integral must first be transformed so that the limits 
become — ^ and just as was done when using the Gauss formula. From 
the previous example we have 


Hence 


yo 


yi 


y-i 


x = 7u + 8.5, y = l/x, = 

^ “ iy 

^ “ 7(0.327327) + 8.5 “ 10.79129 0.09266725 

7 (—0.327327) + 8.5 6.20871 
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y2 — <l>{th) 7(0 6) 8.6 12 

y .2 — ^(u-s) — 7 (_o. 5 ) +8.6 ■" ~5 ' 

Hence 

The error in this value is 0.00015. 

51. Tchebycheff’s Formula. TchebychefE * devised a quadrature formula 
in which the coefficients of the are all equal. His formula is 

(1) = (1/w) + <^(^3) + • * + 

and therefore 

y dx = - [</>(Ui) -f" <^(^ 2 ) + <#>(^ 3 ) + • • * + it>{Un)^. 

a fl 

The points of subdivision of the interval of integration are symmetrically 
placed with respect to the midpoint of the interval. The u’s are the zeros 
of certain polynomials, the first few of which, equated to zero, are; 

(2«)=‘— 1/3 = 0 

(2«)» — i(2«) =0 

(2u)« — (2/3) (2u)* + 1/45 = 0 

(2u)'— (5/6)(2«)>+ (7/72) (2w) =0 

(2u)« — (2u)« 4- (1/6) (2u)* — 1/105 — 0. 

The values of the u’s for n = 2 to n- = 7 and n = 9 are : 

n — 2. = 0.288675 

= 3. Uo = 0, u,2 — 0.353553 
n = 4. M,, = 0.0937962, u ,2 = 0.397327 
n— 5. Uo — 0, 14,1 = 0.187271, «,2 = 0.416249 
n — 6. 14,1 = 0.133318, u,, = 0.211259, i4„ = 0.433123 
n — 7. i4o — 0, 14,1 = 0.161956, 14,2 = 0.264828, 14,3 = 0.441931 
n = 9. i4o = 0, 14,1 = 0.0839531, 14,2 =0.264381, 14,, = 0.300509, 
i4,« = 0.455795. 

• P. Tchebichef, “ Sur lea Quadratures.” Journal de Mathematiques, 1874, p. 19. 
Some of the numerical values on p. 25 of that paper are incorrect. 
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Because of the fact that the functional values all have equal weight (the 
same coefficient) in Tchebycheff’s formula, this formula is particularly 
appropriate for use when the functional values are found by measurement; 
for in that case the positive and negative errors of measurement will largely 
cancel one another. Tchcbycheff’s formula would be ideal for finding areas 
from drawings if it were not for the fact that the points of division are not 
readily located. Even so, these points can probably be located with an 
accuracy equal to that of the drawing. 

Example. Compute by Tchebycheff^s formula the value of the integral 

I , for n = 5. 

Solution, PJere we must express x in terms of u as in the two preceding 
examples. We have 

a: = 7M + 8.5, y = I/t = = ,^(«) 

Then 

= ^ = 0.117647 

O.t) 


Hence 


^ 7(0.187271) +“8.5 "" 
^ ) = 7 (—0.187271 ) +’8”r; 

<t>(u2) = 7 ( 0 - 416249 ^^^ 

</>(i^_o) = T^-Q 410249) + 8.5 


9.810897 

1 


7.189103 

1 _ 

11.413743 " 
__ 1 
5.586257 


0.101927 
= 0.139099 
= 0.087614 
= 0.179011. 


/ = -^-(0.117647 + 0.101927 + 0.139099 + 0.087614 + 0.179011) 
o 

= 0.875417. 

The error in this result is 0.000051. 


52. Euler’s Formula of Summation and Quadrature. The approxi- 
mate relation between integrals and sums is expressed by Euler’s summa- 
tion formula. Written as a quadraiure formula it is * 


* For the derivation of Euler’s formula see Vall<^e- Poussin’s (lours d* Analyse In- 
ftnit^simalCy II, p. 341; Whittaker and Robinson’s Calculus of Observations, p. 134; 
or Charlier’s Mechanik dea Himmels, II, §1. 
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fyix)dx = h [l^+/(ar,)+/(x,)+- • . + 

^ [f (6) -/'(«)] + ^ irib) -r (a)] 

- ^ -/»] + [rw -r(^)] — • ■] 

* * ■ + 

By adding and subtracting ^[/(a:o)/2 + /(^^n)/^] on the right-hand side 
of (1) we have 

f^''f(x)dx = k[f(x,) +f(x,)+- ■ ■+f(x„)]~j[f(xo)+f(x„)] 

-^Lf (&)-/'(«)] + ■ • 

Transposing and dividing through by k, we get 
/(Xo)+/(xO+- • ■ +f(^n) jj^'’f(x)dx+ j [f(Xo) +f(x„)] 

+ ^3 [f'(b) -f(a)] - [/"'(&) -/'"(«)] + • • •, 

or, since Xo = a, Xn = h, 

= lfy{x)dx+ -A [/(a) +/(6)] [f (6) -f (a)l 

(2) rf"(6) -/"'(.)] + [fw -r(«)] 

Formula (2) is Euler s summatioii formula. Tt is useful for finding 
the approximate sum of any number of consecutive values of a function 
when these values are given for eipiidistant values of x, provided the 
integral f^f{x)dx can be easily evaluated. In Ihese formulas h is the 
distance between the equidistant values of j\ so that nh =& — a. 

Note. Formulas (1) and (2) differ in an important respect from the 
quadrature formulas previously derived. In (1) the terms on the right- 
hand side, beginning with (// /12) \f'(h) — /'(^)], form an asymptotic sc: ies. 
The same is true of (2), beginning with the term (b) — /'(a)]- 

An asymptotic series is an infinite series which converges for a certain 
number of terms and then begins to diverge. In computing with such a 
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series it is important to know what term to stop with in order to get the 
most accurate result. We should stop not with the smallest term but with 
the term just before the smallest) for the error committed is usually less 
than twice the first neglected term * and is therefore least when the first 
term neglected is the smallest term in the series. For the reason just given 
it is important that Euler’s formula be used with caution, especially when 
finding sums by (2). We shall now apply each of these formulas to an 
example. 

Example 1, Compute the value of tt from the formula 

TT dx 

Jo r+^‘ 

Solution. We take h = ^ and compute the values of y = 1/ x^) 
at each point of subdivision, as shown in the table below. 


X 

y 

X 

y 

0 

1 


0 69230769 


0 97297297 


0 59016393 


0 9 

1 

0 5 


0 8 

1 



We next compute the derivatives of 1/(1 x^), as given below. 


Hence 


/(^) 


r(x) 


nx) 


l+x^’ 

2x 


ii + x^y’ 

24x(l—x‘) 

(1+x^r ’ 


f(0)=0, f {1)^-1 

r(o)=o, r(i)=o, 

/v(0)=0, f(l)=15, 

/''ii(0)-=0, f’“(l)=0. 


See Charlier, loc. cit., p. 14. 
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Substituting all these values in (1), we get 

1 [0.75 0.97297297 + 0.9 + 0.8 + 0.69230769 + 0.59016393] 

- 36^2(- i) - 6» X 30840 O') 
which is correct to its last figure. 

Example 2. Find the sum of 


1 

5P 


+ — +—+* • • + 
^ 532 ^ 552 ^ ^ 


1 

99=* ■ 


Solution, Here f(x) = 1/x^ and h = 2. Then 


f(x)=- 


r(^) 






40320 


Bemembering that a = 51, 6 = 99, and substituting in (2), we get 


^99 

dx 1 

r 1 

+ 

1 " 

1 . 1 1 

r 1 

J 61 

+ ^ 


99*. 

J+Tl 

L51* 

4 1 

r 1 

±1 

+ 

16 r 

- 1 

1 ■ 

15 1 

Lsi" 

99* J 

21 1 

.51* 

99*. 

641 

r 1 _ 

1 1 





15 1 

L51» 

99“J 






= 0.004753416 + 0.0002432490 
+ 0.0000021694 — 0.0000000008 
*= 0.004998833. 



If we had attempted to find the sum of the squares of the reciprocals 
of all the odd numbers from 1 to 99 we could not have obtained it accurately, 
for each bracketed quantity after the second would have been practically 
unity and therefore the various terms would have been the same as the 
coefficients 4/15, 16/21, 64/15, etc. To get the greatest accuracy in this 
case we should have to stop with the third term and even then the error 
might be nearly 8/15. Hence the necessity for caution in finding sums 
by means of Euler’s formula. 


53. Caution in the Use of Quadrature Formulas. The student should 
ever bear in mind that when computing the value of a definite integral by 
means of a quadrature formula he is really replacing the given integrand 
by a polynomial and integrating this polynomial over the given interval of 
integration. The accuracy of the result vrill depend upon how well the 
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polynomial represents the integrand over this interval; or, geometrically, 
on how well the graph of the polynomial coincides with the graph of the 
integrand. Before beginning the computation of an integral by a quadra- 
ture formula the computer should ascertain the nature and behavior of the 
integrand over the interval of integration. In some instances it may be 
necessary to construct an accurate graph of the integrand. The computa- 
tion can then be planned with reference to the nature and behavior of the 
function to be integrated. The following example will illustrate this point. 

Example 1. Find by Simpson^s Rule the value of the integral 
J __ xW 1 — (Lr 

Solution. The integrand is evjdentl}'^ negative from x == — 1 to a: = 0, 
and positive from x 0 to == 1. Hence we divide each of these intervals 
into four equal parts and com])ute the value of llie inlegrand at each point 
of subdivision. The results are given in the table bcdow. 


X 

i 

X 

y 

-1 

0 

0 25 

0 000001656 

- 0.76 

-0 0001231 

0 60 

0 000486 

-0 60 

-0 00001763 

0 76 

' 0 02070 

-0 26 

-0 000000304 

1 

0 

0 

0 




On applying Simpson’s Rule to these tabular values we find 


= — 0.0000441, 

7o^ = 0.006981, 

/ = — 0.0000441 -f 0.006981 = 0.006937. 

This result could be accepted with confidence if the tabular values were 
of the same order of magnitude, but the table shows that the integrand 
at X = 0.50 is enormously larger than it is for smaller values of x, and 
that at X = 0.75 it is enormously larger than at x = 0.50. Hence we had 
better examine this function more closely in the region from x = 0.50 to 
X — 1 and possibly make a new computation of the integral. 
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X 

V 

X 

y 

0.50 

0.000485 

0 80 

0.038468 

0 55 

0.001136 

0 82 

0 048654 

0 60 

0 002514 

0.84 

0.061016 

0 65 

0.005297 

0 86 

0 075765 

0 70 

0.010688 

0 88 

0 092918 

0.75 

0.020701 

0.90 

0 11221 

0 80 

0 038468 

0.92 

0 13259 



0 94 

0 15149 



0 96 

0.16306 



0.98 

0.15190 



1 

0 


The above table shows the variation of the integrand in the interval 
0.50 ^ a; ^ and Fig. 4 shows the graph for the whole interval from 
x = — ltoa:=l. A glance at the graph shows that in order to obtain 

Y 



Fzq. 4 
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a trustworthy result we should divide the computation into three distinct 
parts : 

(1) By taking h = 0.25 in the interval — 1 < x < 0.5, 

(2) By taking h = 0.05 in the interval 0.5 < a: < 0.8, 

(3) By taking h == 0.02 in the interval 0.8 < a; < 1. 

The results of these computations are 

7 0.0000031, 

7 = 0.002898, 

7 ‘ g = 0.020651, 

7 0.0000031 + 0.002898 + 0.020651 = 0.0235. 

Even when the graph of the integrand is a smooth, regular curve in 
the interval of integration a quadrature formula may not give a very 
accurate result unless the subdivisions are very small. This fact is illus- 
trated by the following example. 

Example 2, Find by Simpson’s Rule the value of 
7 = J" V(l — 3-")(2 — 

Solution. The values of the integrand are given in the table below. 


X 

y 

X 

y 

-1 

0 

0.1 

1.371496 

- 0.9 

0 742294 

0 2 

1 314534 

-0 8 

1.003992 

0.3 

1 243756 

- 0.7 

1 173456 

0 4 

1.159310 

- 0.6 

1.289961 

0 5 

1 060660 

-0 5 

1.369307 

0 6 

0 946573 

- 0.4 

1.419859 

0.7 

0.814248 

- 0.3 

1 . 446720 

' 0.8 

0 657267 

- 0.2 

1.453272 

0.9 

0 457165 

- 0.1 

1.441874 

1 

0 

0 

1.414214 




The correct value of the given integral to five significant figures is found 
from a table of elliptic integrals to be 


/ — 2.2033. 
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Simpson^s Eule gives the following values for different values of h : 

(a) I = 2.0914 for h = 0.5. Percentage error = 5.1%. 

(b) / = 2.1751 for h = 0.2. Percentage error = 1.28%. 

(c) 7 = 2.1934 for h=^0.1. Percentage error = 0.42%. 

It will be observed that when the interval of integration was divided 
into 20 subintervals the error was nearly a half of one per cent, which is 
less than slide-rule accuracy. Inasmuch as the tabular values are all 
correct to six or seven figures, the errors in the results found above are 
due entirely to the inherent inaccuracy of Simpson’s Rule. The trouble 
with this problem lies in the fact that the integrand cannot be approxi- 
mated closely by a polynomial near the end points of the range of integra- 
tion, for at these points the slope of the integrand is infinite. A better 
approximation can be obtained by using horizontal parabolas for the regions 
near the ends of tlie interval (see Note 2 on p. 137). Thus, for the region 
at the left end of the interval, we have 

7, = (2/3) (0.2 X 1.003992) = 0.1338656 ; 

and for the region at the right end we have 

72 = (2/3) (0.2 X 0.657267) = 0.0876356. 

Then the application of Simpson’s Rule to the region from x = — 0.8 to 
X = 0.8 gives 

Is = 1.9780924. 

The sum of these is 

7,-1-72 + ^3 = 7 = 2.1996, 

the percentage error of which is 0.17 per cent. 

In Art. 57 several formulas will be derived for the inherent error in 
Simpson’s Rule, but occasionally a problem may arise when the approximte 
error cannot be easily determined even Muth the aid of those formulas. 

54. Mechanical Cubature. In this article we shall give two methods 
for finding the numerical value of a definite double integral of a function 
of two independent variables. The first method will be by application of a 
formula which may be regarded as an extension of Simpson’s Eule to 
functions of two variables. The second method is simply by repeated 
application of the ordinary quadrature formulas for one variable. 

To derive the double quadrature formula we start with the formula for 
double interpolation, namely (X) of Art. 41, and integrate this formula over 
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two intervals in the y-direction and two in the a;-direction, first omitting 
from the formula all terms involving the differences A®*^, 

^1+3^ ^0+4^ since these differences involve values of the function outside the 
rectangle over which we are integrating. 

Since dx = hdu, dy =* hdv we have, after omitting the terms just 
mentioned, 

/ == 1 I zdydx = Afc I I -1200 + mA‘+®Zoo + vA'>*^Zoo 

+ [“(“ 1)A®*®2oo + 2uvA^*^Zoa + V{V 1 ) A®+%(,] 

+ "T [3w(w — 1 )i;A“’’2oo + 3uv(v — l)A‘*%o] 

D 

+ ^ [6u(u — — l)A2^22^o] | dv du. 

Performing the indicated integrations and replacing the double differences 
by their values as given in Art. 40, we get 

hk 

(1) I = [^Jqo “f" ^02 “t" '^22 “f" 2:20 “f“ 4(201 ^12 “h ^21 “1“ ^ 10 ) “1“ 

This is the formula which corresponds to Simpson’s Rule for a function 
of one variable. It can be represented diagramatically as shown in Fig. 5, 
the coefficients of the several 2 ^s being shown on the diagram. By adding 
any number of unit blocks of this type we could obtain a general formula 
for double integration, corresponding to Simpson^s Rule for n intervals in 
single integration, but it is not worth while to do this. 

Formula ( 1 ) can be rewritten in either of the following forms : 


(2) 2 + • — (210 + ^^11 + ^12)+ ^(2:o2 + 'l2i2 + 222)], 

(3) I — ^ (2^00+42] o+22o)+4 • — (2oi + 42u-|-22i)+ ” (202 + 4212+222)]- 


Now, such an expression as (k/3) (200 + 42io + 220 ) is nothing but Simpson^s 
Rule applied to a single row in the diagram, in this case the top horizontal 
row. Let us put 

h k 

Ao = ^ (200 + 42io + 220 ), = - ( 2 oi + 42n + 221 ), etc. 

Then (3) becomes 
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This formula shows that formula (1) is equivalent to applying Simpson^s 
Kule to each horizontal row in the diagram and then applying it again 
to the results thus obtained. These considerations lead to the following 
general statement: 

If we are given a rectangular array of values of a function of two 
variables, we may apply to each horizontal row or to each vertical column 
any quadrature formula employing equidistant ordinates, such as Simpson's 
and Weddle's formulas. Then to the results thus obtained for the rows 
{or columns) we may again apply a similar formula. 



This important result makes it unnecessary to derive general formulas 
for approximate double integration. 

It is instructive to notice the geometric significance > of this general 
statement. Since the double integral between constant limits of a func- 
tion of two variables is represented by the volume of a solid havirg a 
rectangular base and a height at any point equal to 3/)], it is 

evident that the integrals Aq, Ai, etc. are merely vertical cross-sectional 
areas of this solid made by equidistant planes. Then when we apply a 
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quadrature formula to these A^s we are merely finding the volume of the 
solid, as if we evaluated the integral f^Aadx. 

An engineering application of mechanical cubature would be the solution 
of such a problem as the following: 

Suppose it were necessary to determine the amount of earth to be moved 
in making an excavation for a large building on uneven ground, or in 
grading down or filling in a city block. The area to be excavated would 
be divided up into small rectangles by running two systems of equidistant 
parallel lines at right angles to each other. The distances of the corners 
of these rectangles above or below an asumed datum plane would be the z^s 
of this article. Knowing these z^s and the distances between the parallel 
lines (the h^B and fc’s), we could find the volume of the excavation by the 
methods given above. 

We shall now work two examples by these methods. 

Example 1, Find by formula (1) the value of the integral 

/= C' 

xy ' 

Solution, Taking h = 0.2 and k = 0.3, we compute the values of 2 : = 1/xy 
shown in the table below. 


^ X 

4 0 

4 2 

4 4 

2.0 

0.125000 

0.119048 

0.113636 

2 3 

0.108696 

0.103520 

0.0988142 

2.6 

0.096154 

0 0915751 

0 0874126 


Substituting these in (1), we get 

I = ^ [0.12500 + 0.096154 + 0.0874126 -f 0.113636 

+ 4(0.108696 + 0.0915751 +D.0988142 
+ 0.119048) + 16 X 0.103520-] 

= 0.0250070. 

The true value of the integral is 

J4, J 2 xy 

= 0.0953108 X 0.262364 
— 0.0250061. 
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The error is therefore 


E = 0.0250061 — 0.0250070 = — 0.0000009. 

Example 2, Find by numerical integration the value of the integral 

7= r**'' 

J 4 J 2 xy ' 

Solution. Here we take h = 0.2, Ic = 0.3 as before, and compute the 
following table of values of z=l/xy. 


Nv X 

y\ 

4 0 

4 2 

4 4 

! 

4 6 

4 8 

5 0 

5 2 

2 0 

0 125000 

0.119048 

0 113636 

0 108696 

0 104167 

0 100000 

0 096154 

2.3 

0 108696 

0 103520 

0 0988142 

0.0945180 

0 0905797 

0 0869565 

0 0836120 

2 6 

0 096154 

0 0915751 

0 0874126 

0 0836120 

0 0801282 

0 0769231 

0 0739645 

2 9 

0 0862069 

0 0821018 

0.0783699 

0 0749625 

0 0718391 

0 0689655 

0 0663130 

3.2 

0 078125 

0 0744048 

0 0710227 

0 0679348 

0 0651042 

0 0625000 

0 0600962 


Applying Weddle’s Rule to each horizontal row, we have 

Ao=- 0.06[0. 125000 + 5(0.119048) + 0.113636 + 6(0.108696) 
+ 0.104167 + 5(0.100000) + 0.096154] 

= 0.131182, 

Aj = 0.114072, A 2 =^ 0.100909, A 3 = 0.090470, 

A 4 — 0.081989. 

Now applying Simpson’s Rule to the A’s, we get 
7 = 0.1[0. 131182 + 4(0.114072) + 2(0.100909) 

+ 4(0,090470) -f- 0.081989 = 0.123316. 
The true value of this integral is 

^ 6.2 ^ 8.2 j j g ^ 0.12332], 

J 4 J 2 ary 
and the error is therefore 

E = 0.123321 — 0.123316 = 0.000005. 


55. Prismoids and the Prismoidal Formula. The formula to be con- 
sidered in this article is a special form of Simpson’s Rule and the oldest 
form of that rule. It is treated here because of its importance and wide 
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applicability in the mensuration of solids. The formula will be derived 
with reference to a solid. 

A prismoid may be defined as a solid whose bases are polygons in parallel 
planes and whose lateral faces are ruled surfaces, either plane or warped. 

If we let one base of the prismoid lie in the y 2 ;-plane and let the lateral 
faces extend in the general direction of the positive a:-axis, the volume 
of the prismoid will be given by the integral 

fA{x)dx, 

where A{x) denotes the area of a cross section parallel to the bases and 
at a distance x from the yz-plsme. To find A(rr), let 

(1) y-=ax+1) 

(2) z = cx d 

be the equations (in projection form) of any moving straight line. Such 
a line can move in any manner and will generate a ruled surface as it 
moves along. In a plane parallel to the y 2 ;-plane and distant x to the 
right of it the area of the cross section of the prismoid is given by the 
integral 

^ (^) = 

the integration being extended over the entire cross section. 

Now, in the fixed plane under consideration a: is a constant, and y and 
z are functions only of the parameters a, b, c, d\ that is, in this plane 
y and z can vary only when and as the parameters vary. Let each of these 
parameters be a function of a single parameter a. Then y and z become 
functions of a, and from (2) we have 

dz {cx d)d(x = (c'a* + d')d 2 . 
act 

The integral giving the area of the cross section now becomes 

A{x) = S ydz^ ^ (ax + 6) (c'x (Z')da 

= r ac’dct-\-x \ {be' nd')d(x C bd'da, 

Oo ^ Oo Oo 

where it is assumed that the entire cross section is covered when ct varies 
from ao to ai. Since each side of the cross-sectional polygon is a section 
of a different ruled surface, the integrands above will change (be replaced 
by others) as the different sides of the polygon are encountered.* Also, 

* The integral giving A{w) in this problem is really a line integral. See E. B. 
Wilson’s Advanced CalculuSy p. 289, or Goursat-Hedrick, Mathematical Analyeie^ 
Vol. I, pp. 187-189. 
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since the above integrals in the expression for A{x) are independent of x, 
they may be denoted by p, q, r, respectively. Hence we have the important 
result that 


( 3 ) 


A (x) = px^ + 5^3; + r. 


which shows that the area of the cross section of a prismoid is a quadratic 
function of its distance from one base and therefore from either of its bases. 

To find the volume of a prismoid of length Z, we take coordinate axes 
with the y 2 ;-plane coinciding with the midsection of the solid. Then 


( 4 ) 


X I/2 1/2 

A{x)dx=^ I {px^ qx r) dx = rl, 

■ 1/2 ~ i /2 


Let Bi and B 2 denote the areas of the bases of the prismoid and let M 
denote the area of the midsection. Then from (3), 

il/ = ^(0) =*=r 


Br 


Sr 

4 2 ^ 


Hence 




+ = ^ +2r = ^~ + 2M, 


from which 




2il/l 


Substituting in (4) the values of p and r just found, we get 

( 6 ) V^-~{B, + B, + m), 


which is the Prismoidal Formula, The reader should keep in mind the. 
verbal statement of this formula, namely: The volume of a prismoid is 
equal to one sixth the product of its length by the smn of its bases and 
four times its midsection. 

It is to be noted that the prismoidal formula gives the exact volume 
not only of the prismoid but also of any other solid in which the area of 
the cross section is a quadratic function of the distance of the cross section 
from one base. Such solids are cones, pyramids, spheres, spherical seg- 
ments, frustums of cones and pyramids, wedges, paraboloids of revolution, 
and other solids of revolution. It also gives with close approximation 
the volumes of barrels and casks. 

Note. Some writers use the terms prismoid and prismatoid inter- 
changeably, as if both terms referred to the same solid. Such is not the 
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case, however. A prismatoid is usually defined as a polyhedron (a solid 
with plane faces ) ) having for bases two polygons in parallel planes and 
for lateral faces triangles or trapezoids with one side common with one 
base and the opposite vertex or side common with the other base. The 
volume of a prismatoid is found by decomposing the solid into pyramids 
having their vertices at a point in the midsection. The volume of a pris- 
matoid is given by the prismoidal formula because the area of the cross 
section of a pyramid made by a plane parallel to its base is proportional 
to the square of the distance from the section to the vertex (or base) of 
the pyramid; that is, the area of the section is a quadratic function of its 
distance from the base. 

The prismoidal formula is the fundamental formula for computing the 
volume of earth in cuts and fills for railroads, highways, canals, etc. The 
cross-sectional areas of cuts (or fills) are determined at convenient intervals 
(100 feet apart or less) and then the volume of earth to be excavated 
(or filled in) is computed by the prismoidal formula. 

Example. A proposed railroad cut 100 feet long is represented approxi- 
mately to scale in Fig. 6. Compute the number of cubic yards of material 
to be excavated. 


E 



Fio. 0 
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Solution, The areas of the bases and midsection are found by subtracting 
the areas of the two triangles from the area of a trapezoid in each case. 
Hence 

Bi = 51 ^ i ^ — i(8 X 12) — i(14 X 21) = 366 sq. ft., 

= 4r) -- 4 (6 X 9) — i (12 X 18) => 270 sq. ft., 

Jl/ = 48(10) — 150 =. 330 sq. ft., 

and therefore 

F = ^ (366 -1- 270 + 4 X 330) = 32,600 cu. ft. = 1207.4 cu. yd. 

When the prismoidal formula is used to find the volume of a solid in 
which the cross-sectional area does not vary as the square or cube of the 
distance of the section from one base, the error committed is the same as 
that in Simpson's Rule (see Art. 57). 


EXERCISES VII 

1. In the table below are given corresponding values of a variable x 
and an unknown function y. For what value of a; is y a minimum? 


X 

y 

3 

-205 

4 

-240 

5 

-259 

6 

-262 

7 

-250 

8 

-224 


2. For what value of x is the following tabulated function a minimum? 


X 

y 

0.2 

0 9182 

0 3 

0 8975 

0 4 

0 8873 

0 5 

0 8862 

0 6 

0 8935 

0.7 

0.9086 
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3. In the year 1918 the declination of the sun at Greenwich mean noon 
on certain dates was as given below. Find when the declination was a 
maximum. 


Date 

Declination 

June 19 

23° 25' 23' .5 

“ 20 

“ 26 19 .4 

“ 21 

“ 26 50 .5 

" 22 

“ 26 56 .8 

“ 23 

“ 26 38 .3 

“ 24 

“ 25 55 .1 

“ 25 

24 47 .1 


4 . Compute the value of 

X *’/2 

V 1 — 0.162 sin^ <t> d<\> 

by Simpson^s Rule and by Weddle^s Rule, taking 

<^ = 0°, 15°, 30°, 45°, 60°, 75°, 90°. 

Compare your results with that found by the series method in Exercise 
25, Chapter I. Also compare the amount of labor involved in each case. 


/ • 1 dx 

■ . ' 4 -Y 7 f by Gauss’s method, taking n — 5. 
0 V ^ + 1 


6. Compute by Simpson’s Rule the value of the integral 

^ 200 lO^lO ^ 

taking eight subintervals. 

7 . Find by Weddle’s Rule the value of the integral 

^ r xdx 
J 0.4 sinh X ’ 


taking twelve subintervals. 
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by Simpson’s Rule. 


X 

\ 0-5 1 

0.6 

1 1 

1 1 

0.9 

1.0 

1 1-1 

y 

1 0.4804 1 

0.5669 

1 0.6490 

0.7262 

0.7985 

0.8658 

1 0.9281 
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THE ACCURACY OF QUADRATURE FORMULAS 

56. Introduction. A computer should have some means of estimating 
the reliability of every compuied result. It is not always possible to have 
an explicit formula giving the error committed, but usually there exists 
some means for ascertaining the magnitude of the majority of unavoidable 
errors. In the present chapter we consider the accuracy of the more im- 
portant quadrature formulas and give expressions for the inherent errors in 
several ot them.* 

^7, Formulas for the Inherent Error in Simpson's Rule, (a) The 

General Formula. Let f(x) denote a function which is finite and con- 
tinuous in the interval x = Xo— h to x = Xo h and has continuous 
derivatives of all orders up to and including the fourth in that interval. 
Furthermore, let F(x) denote the integral of f(x)y so that 

F{x) = f{x)(lx. F’(x')=f{x), F'{x) =f{x), etc. 

Then 

J ' iTo+A 

f{x)dx = F{x„ + h) — F{xo — h). 

SQ-h 

The value of this integral by Simpson's Rule is 

= y [/(arc- -h) +4/(x„) + /(^o -f ^0]- 

The difference betw^een these results is the inherent error in Simpson's Rule, 
so that 

( 1 ) Es-=I-h=-F{x„ + 1i)—F{x„-h)--^-[f(xo-h)+4f{x,) 

+ /(^O + ^) ]• 

This formula is of no practical value as if stands, because it is indefinite 
and cumbersome. It can be reduced to a simple and workable form in 
either of two ways. 

* A method for comparing the relative accuracy of quadrature formulas em- 
ploying equidistant ordinates will be found in the following literature: 

1. “On the Relative Accuracy of Simpson’s Rules and Weddle’s Rule,” American 
Mathematical Monthly, Vol. XXXlV, No. 3 (March, 1927), pp. 135-139. 

2. ITie first edition of this book, pp. 153-155. 
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1. The expression for Ea is clearly a function of h. Hence, following 
the method of Vallee-Poussin, we denote it by ^{h) and write 

+ — [/(xo — fe) + 4/(x„) + /(xo + A)]. 

Differentiating both sides successively with respect to h, we have 

,f/{h) =f{xo + h) +f{xo — h) ^[f'{xo + h) —f'{xo — h)'] 

O 

- yC/K + fc) +4/(a:.)+/(x„-;i)], 

<l>"(h) = fix, + h) -f(xo — h)—j lf"(xo + A) + r(xo - A) ] 
[nx, + h)-fix,-h)-\, 

</,'" ( A) = - y [r (xo + h)- r(xo - ft) ] . 

By the theorem of mean value this last expression in brackets is equal to 
where Xo — h ^ Xo h. Hence 

0/,2 

(2) ^"'(ft)=--^/‘v(|). 

On putting h = 0 in the expressions for i>{h), we find that 

^(h) =^<l>'{h) —0. 

We now integrate (2) three times with respect to h, either by integrating 
from 0 to h or by determining the constant of integration at each step. 
In either case we make use of the relations (t>{h) =0, =0, and 

(f>"{h) =0 for h = 0. Although the factor /"' (O depends to some extent 
on the magnitude of the interval (0,h), w'c can replace it by its mean value 
in the interval and remove it from under the integral sign. Assuming that 
this is done at each step, we have 
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Since this <l>{h) is the inherent error for an interval of width 2 A, the 
inherent error for a subinterval of width h is half this amount, or 

180^ 

Then since h — a = nh, we have as the inherent error for the whole 
interval b — a: 

( 57 . 1 ) 

where ^ now lies between a and 6, or a < ^ < 6. 

2. Another way of simplifying (1) is by means of Taylor's theorem. 
Expanding F{xo-\-h) and F(xo — h) by Taylor's theorem and remem- 
bering that F'{xo) ^^'{xq) ^f(xo), etc., we have 

F(xo + h) = F{xo) + hf{x„) + Y f (*o) + Y + • • • 

F(x„-h)=^F{xo)-hf{xo)+Yf(^o)-Y/'i^o)+- • • 

Also, 

f(Xo + h) ^f{Xo) + hf(Xo) + y r(^o) + ^ r(xo) -f • • • 

f{xo h) = f{xo) hf (a^o) -r y f'(xo) — — f"(xo) + * * . 

On substituting in (1) these values for F(xo + A), 2^(xo — A), /(a:o -f A), 
and f{xo — A), we get 

■ ]. 

Hence the inherent error for the whole interval h — a is 

(3) Es = ~-^ [/-(a:i) + f-ix,) + • • • + /-(x^i)] . 

Let denote the greatest value of any of the n/2 quantities within 

the bracket. Then 

( 67 . 2 ) ^ 

The values found for Es show that Es^O when f^(x) —0. Hence 
when f(x) is a polynomial of the first, second, or third degree, Simpson's 
Rule gives the exact value of f^f{x)dx. 
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(6)/ A Formula in Terms of Differences. In many applications of 
Simpson’s Rule the analytical form of the function to be integrated is 
either totally unknown or else is of such a nature that its fourth deriva- 
tive is difficult to calculate. In either case formula (3) can not be applied 
as it stands. We get around the difficulty by transforming it into another 
form. 

Let us replace the derivatives • •, etc. by their values 

in terms of differences. For this purpose we write Stirling’s interpolation 
formula in the form 

y = fi^) = /(fc + Aw) = y* + M ^ 

w(w* — 1^) 

“•■a! 2 -!-• • • 

to fourth differences. 


Differentiating this formula with respect to x by means of the formula 
dy/dx =* {dy/du) (du/dx) and the relation x = Jc hu, ov u = {x — 
and then putting u == 0 in each derivative, we get 


/-(i) 


h* • 


Now putting k = Xi, X 3 , ■ ■ ■ writing = A^y.,, etc., and sub- 

stituting in (3) these values of the fourth derivatives, we get 

(4) E8=—~ (A‘y-1 + A«yi + A^y, + ’ ' ' + 

This expression for the error in Simpson’s Rule is identical with the 
third set of terms in our central-difference quadrature formula (48. 1). 
That formula is therefore Simpson’s Rule plus its correction terms, as was 
stated on page 141. 

(c). A Formula in Terms of the Given Ordinates. To get a formula 
for Ea in terms of the given ordinates, we replace the differences in (4) 
by their values in terms of the y’s as given in Art. 16, Table 3. Since 

A Vi = ^3 — 4^2 + 6t/i — 4yo + y-i, ' 

— 4t/4 + 63/3 — 4t/2 + Vly 


= yn^i -f 6yn-i ^yn .2 + ^n-a, 

we have, on substituting these in (4), 
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(5) Es = — [_y-i + yn+i — 4(yo + yn) + (yi + yn-i) 

8(t/:.4"y4 + ‘ ■+ yn- 2 ) + 8(^3 + ^5 + • • *4-3/n-3)] 

when n ^ 6. 

If the number of subintervals be less than six, the formulas for Ea are 

(6) ii’s = — ^[y-i +3/3 — 4 (y„ + y„) 4-61/,], for n = 2 . 

( 7 ) Ea = — [y-i + 3/3 — 4 (j/o + 3/4) +7(3/1 + j/a) — 82/2], for n = 4 . 


The ordinates and yn^\^ which are outside the interval of integration^ 
can be found in one or more ways. If the values of y are computed from 
a formula and tlie formula holds outside the interval of integration, then 
we merely compute y.^ and yn+x from this formula by substituting the 
proper values of x. But if we are given only a tabular set of y’s we find 
t/_i and yrx^x by extrapolation, the former by using Newton^s formula (I) 
and the latter by using Newton's formula (Tl). 

(d) A Formula in Terms of Two Computed Results. Suppose two 
computations of a definite integral are made by Simpson’s Rule, using a 
different value of h for each computation. Tx^t i?i, hi, E^ denote the 
result, the value of h, and the error in the first computation, and let Rn, 
ho, Eo denote the corresponding quantities in the second computation. 
Then by ( 57 . 1 ) or ( 57 . 2 ) we have 


E, 


K 

hA ’ 


or El 



Hence if ho ^ 


h 

2 


we liave 


Ex = 16i;2 . 


Let 1 denote the true value of the given integral. Then for the two 
computations we have 

/ ■= Ri -|- El = Ri 16^2 , 

I = R2 “ 4 ” E2 • 


Subtracting the upper equation from the lower and solving for E2, we get 


( 8 ) 




Eo 


Ro — R, 
15 


This formula tells us that if we compute the value of a definite integral 
by using a certain value for h and then compute it again by using twice 
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as many subdivisions, the error of the second result will be about 1/1 5th 
of the difference of the two results. 

(e) To Find the Value of h for a Stipulated Degree of Accuracy in the 
Result. If we wish to know the value of h to obtain a result of stipulated 
accuracy, we substitute in (57.1) or (57.2) the allowable error E, the 
maximum value of f^^'{x), the value of h — a, ignore the negative sign, 
and solve for h. 

In case cannot be found, assume a convenient value h^ for h, 

find El by (4) or (5), and use the relation- - = , from which 

Hi n n 



where Ep denotes the allowable error. 

We shall now apfily formulas (5) and (57. 1) to the first example 
worked in Art. 45. 

Example. Compute by means of (5) and (57. 1) the error in the 
evaluation of j^^'^lnxdx by Simpson’s Rule. 

Solution, We must first compute y_, and from the given function 
y = In X. For these we have 

y.i =ln 3.8 = 1.33500107, 

= In 5.4 = 1.68639895. 

The values of y from y^, io lu inclusive are given in the table on page 134. 
Substituting these y's in (5), we get 

Es = ^ [3.02H000-.> - 4(3.034!)5‘>!)9) 

+ 7(3.04452244) —8(3.05022046) 

+ 8(1.52605630)] 

= O. OOOOOOl.l . 

The true error was found in Art. 47 to be 0.0()()()()()15. 

To compute the error by (57.1) or (57.2) we first find {x) from 
the equation f{x) = In ar. We thus have 
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This is of the same order of magnitude as the actual error but greater than 
it, as it should be. 

Suppose we wished to know the value of h necessary to give the integral 
correct to ten decimal places. Since we have already found the error 
corresponding to a particular value of h, we can fii\(d the desired value 
by substituting in formula (9). Here 

^ 0.2, JE'i — 0.00000015, < 0.00000000005. 


Hence we have 


h < 0.2 


/ 0.00000000005 ^ 

V 0.00000015 / 


Since h — a = nh, we find that we should have to divide the interval 
(4, 5.2) into more than 45 subintervals in order to get a result correct 
to ten decimal places. 


v/58. The Inherent Error in Weddle’s Rule. In deriving Weddle’s Rule, 

we omitted the quantity — This omitted quantity is the principal 
part of the error inherent in the formula. In terms of derivatives it is 


Hence 
(58. 1) 




140 


/-(x). 


Ew = — 


140 ^ 




140 ^ ^ ^ 


This means that when f(x) is a polynomial of the 5th degree or lower, 
Weddle’s Rule gives an exact result. 

59. The Remainder Terms in Central-Difference^Formulas (48. 1) 
and (48.3). The remainder terms in these formulas can be found by 
integrating the remainder terms in Stirling’s and Bessel’s interpolation 
fromulas from which (48.1) and (48.3) were derived. Since (48.1) is 
at least as accurate as (48. 3), and since a more definite formula can be 
derived for the remainder term in the latter than in the former, we shall 
derive the remainder term for (48. 3) only and use it for computing 
the error in both formulas. In Art. 35 we found the remainder term in 
Bessel’s formula (VI) to be 




(2/1 + 2) ! 




Since f{x)dx is the quantity that is integrated by a quadrature formula. 
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it is plain that Rn{x)dx is the quantity which must be integrated to find 
the inherent error in the quadrature ; and since dx = hdvy we have for 
the error in a single subinterval of width h 


(2n+l)^ ^ _ 8fe2n.s^(2n.2)(^) 


(2n + 2) ! 




dv. 


Let us put 


( 2 ) 

Then 




dv. 


(2n + 2) ! * ” 


This is the error for a single subinterval of width h. Let Mn denote 
the maximum value of in the interval (a, 6). Then since there 

are (b — a)/h subintervals from x = a to x^b, we have for the total 
error in the interval {a,b) 


(3) 




(2n + 2) ! 


(ft-a)l V„\. 


From this general formula we get particular ones by assigning values 
to n. Thus, if we include fourth differences in (48. 2) and neglect all 
higher differences, we put n — 2. Then (2) becomes 


V, 




and therefore (3) becomes 


or, more simply, 

(4) 




19WM. 

60480 


— a) ; 


F " 

a 


< 


li^M, 

316 


(b — a). 


191 

168 " 


In terms of differenc<‘S this becomes 


(5) 

where is the largest of the sixth differences. 
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If we include sixth differences in (48. 2) and neglect all higher differ- 
ences, then n == 3 and (2) becomes 




On substituting these in (3) we find 




2497 

180 


or 

( 6 ) 


, < 24 9r/,M/. 
“ — ■ 3628800 


(b-a). 


EJ‘< 


h*M-, 

1153 


(6-a). 


In terms of differences this becomes 

(7) 


where is the largest of the eighth differences in the interval {a,h). 

When we stop with fourth differences in formula (48. 1) or with third 
differences in (48. 3), the error is to be computed by (5) ; and when we 
stop with sixth differences in (48 1 ) or with fifth differences in (48.3), 
the error is to be computed by (V). 


60. The Inherent Errors in the Formulas of Gauss, Lobatto, and 
Tchebycheff. The inherent errors in the formulas of Gauss, Lobatto, and 
Tchebycheff are usually given in terms of the coefficients in a power series. 
To find the error in any gi\en case, it is therefore necessary to expand the 
function as a power series and })ick out the appropriate coefficients, 

one or more. 

For Gauss's formula the principal part of the inherent error is * 


rn F =- ^ — ^ V 

' (2rt + 1 )2'''' VI ■ 3 • 5 • •(2« — 1)/ 

v ) r a- hiLilf ( n+l)(n + 2) 

X -j + 8 V ,2n 4- 3 

where the L’s are the coefficients in the power series 


n(n - 1 ) 

2n — 1 



(2) cf>(u) = Lq -{- Tj^U -{- -j- ’ ■ ■ -{- * ■ * . 

When the series for </)(i/) is rapidly convergent, the term involving L 2 n +2 
in formula (1) may be omitted. 

If the analytic form of <^(w) is not known, Ea cannot be determined. 


Derived in Todhuntor’s Functions of Laplace, Lam6, and Bessel, p. 108. 
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Example. Find Eo for tlie examplf3 in Art. 49, p. 150. 


Solution. Here 


</)(w) = - 


I 


2 


rw+8.5 14U+17 


— ^ (1 
,-v V 




Since n = IS. 2n-\-2 = \2. Wo niust thorolorf' find fli(‘ ('O(41ic‘ioiits of 
and in the series for <l>{u). We have 



From this series we see that 



and 


Substituting these in (1), we get 


2 

17 



12 


E(j =-- 



n X 2^" M •3-5-7-9 / ]\17/ "^sVi:/ \13 

= 0.00000017 + 0.00000008 = 0.00000025. 



This result agrees well with the actual error 0.00000028 found in Art. 49. 

There are no simple formulas in terms of n for the inherent errors in 
the formulas of Lobatto and TchebYcheff. Formulas for particular values 
of n are given in the tables at the end of the book by B. P. Moors. 

'^61. The Remainder Term in Euler’s Formula. Malmsten’s expression 
for the remainder after n terms in Euler’s formula of summation and 
quadrature is 

(1) = + o<e<i. 


for a single subinterval of width h. 

Let M denote the numerically greatest value of in the whole 

interval (a, h). Then for the n subintervals we have 

(2) R„^nA.,nhr^*^M. 

or, since n= (5 — 

(3) Rr,^A,nh'-^-M{b — a). 


Here A 2 n has the following values: 
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>4 ** 4- i A j X 

12’ ^^^ 720’ ® 30240’ ® "^ 1209600’ 


47900160 ■ 

More useful, perhaps, than formula (3) is the following working rule 
due to Charlicr : * 

In stopping with any term in Euler^s formula the error committed is less 
than twice the first neglected term. 

Hence we get the most accurate result by stopping with the term just 
before the smallest, so that the first neglected term is the smallest of all. 

We shall now show that the first two terms of Euler’s formula will give 
a more accurate result than Simpson’s Rule. 

Putting n =* 2 in formula (3), we have 


lL^A,h*M{h-a)='-^g{h-a), 

where M denotes the greatest numerical value of P"'{x) in the interval 
{a,l). 

The remainder term in Simpson’s Rule is (Art. 57) 




h^Jl 

ISO 


(h — a). 


Hence the inherent error in Euler’s formula for only two terms is just 
one fourth that in Simpson’s Rule. 


EXERCISES VIII 

1. Estimate the inherent errors in your answers to Exercise 4 of 
Chapter YII and compare these errors with that found in Exercise 25 
of Chapter I. 

2 . Compute the inherent error in your answer to Exercise 6 of 
Chapter VII. 

3 . Estimate the accuracy of your answer to Exercise 8, Ch. VII. 


^ Mechanik dea Himmela, II, pp. 13-16. 



CHAPTER IX 


THE SOLUTION OF NUMERICAL ALGEBRAIC AND 
TRANSCENDENTAL EQUATIONS 

I. EQUATIONS IN ONE UNKNOWN 

62. Introduction. It is shown in algebra how to solve literal equations 
of all degrees up to and including the fourth; and it is also shown how 
to compute the roots of numerical equations of any degree. Algebra is 
silent, however, on the solution of such types of equations as ax + 6 log x 
= c, ^ X = 5, etc. These are transcendental equations^ and no 

general method exists for finding their roots in terms of their coefficients. 
When the coefficients of such equations are pure numbers, however, it is 
always possible to compute the roots to any desired degree of accuracy. 

The object of the present chapter is to set forth the most useful methods 
for finding the roots of any equation having numerical coefficients. Since 
Horner’s method is explained in most college algebras, and since it can not 
be applied to transcendental equations, we shall not consider it here. 

-^^3. Finding Approximate Values of the Roots. In finding the real 
roots of a numerical equation by any method except that of Graeffe, it is 
necessary first to find an approximate value of the root from a graph or 
otherwise. Let 

( 1 ) /( x )=0 

denote the equation whose roots are to be found. Then if we take a set 
of rectangular coordinate axes and plot the graph of 

( 2 ) y = 

it is evident that the abscissas of the points where the graph crosses the 
x-axis are the real roots of the given equation, for at these points y is zero 
and therefore (1) is satisfied. Approximate values for the real roots of 
any numerical equation can therefore be found froiji the graph of the 
given equation. It is not necessary, however, to draw the complete graph. 
Only the portions in the neighborhood of the points where it crosses the 
x-axis are needed. 

Even more useful and important than a graph is the following funda- 
mental theorem : 

If f(x) is continuous from x =*= a to x = b and if f(a) and f(b) have 
opposite signs, then there is at least one real root between a and b. 

This theorem is evident from an inspection of Fig. 7, for if f{a) and 
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f{h) have opposite signs the graph must cross the x-axis at least once 
between x a and x = b. 


Y 



In most cases the approximate values of the real roots of f{x) = 0 are 
most easily found by writing the equation in the form 

(3) 

and then plotting on the same axes !:be two equations 

The abscissas of the points of intersection of these two curves are the real 
roots of the given equation, for at these points yi = yz and therefore 
fi{x) **/ 2 (a:). Hence (3) is satisfied and consequently f(x) = 0 is like- 
wise satisfied. 

We shall now apply the foregoing methods to two examples. 

Example 1. Find approximate values for the real roots of 

X logic a; = 1.2. 

Solution. We write the equation in the form /( x ) = x log,(, j* — 1.2, 
assign positive integral values to x, and compute the corresponding values 
of f{x), as shown in the table below. Since /(2) and /(3) have opposite 
signs, a root lies between a: = 2 and x = 3, and this is the only real root. 

X I 1 1 3 I 3 I 4 

/(x) I —1-2 I —0.6 I +0.33 I +1.31 

The approximate value of the roots can also be found by writing the 
equation in the form 

- 1.3 

logio — 

X 
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and then plotting the graphs of yi = logic x and yz *=* 1.2/a:. The abscissa 
of the point of intersection of these graphs is the desired root. 

Example 2. Find the approximate value of the root of 

3a; — cos x — 1=0. 

Solution, Since this equation is the difference of two functions, we can 
write it in the form 

3a; — 1 = cos x. 

Then we plot separately on the same set of axes the two equations 

3/i “ 3a; — 1, 

y2 = cos X. 

The abscissa of the point of intersection of the graphs of these equations 
is seen to be about 0.6 (Fig. 8). 


Y 



Of course we could also find this apj)roximate value by computing a table 
of values of the function f{x)= 3a; — cos x — 1 and noting the change in 
sign of f(x), as in Ex. 1. 

64. The Method of Interpolation, or of False Position (Regula Falsi). 

The oldest method for computing the real roots of a numerical equation is 
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the method of false position, or “ regula falsi.” In this method we find 
two numbers and X2 between which the root lies. These numbers should 
be as close together as possible. Since the root lies between Xi and X2 the 
graph of y=f{x) must cross the a:-axis between x = Xi and x = X2, and 
yi and yo must have opposite signs. 

Now since any portion of a smooth curve is practically straight for a 
short distance, it is legitimate to assume that the change in f{x) is pro- 
portional to the change in x over a short interval, as in the case of linear 
interpolation from logarithmic and trigonometric tables. The method of 
false position is based on this principle, for it assumes that the graph of 
y = f(x) is a straight line between the points {xx^yi) and (2:2, ^2), these 
points being on opposite sides of the rr-axis. 

To derive a formula for computing the root, let Fig. 9 represent a magni- 



fied view of that part of the graph between (xi, yi) and (2:2, ^2). Then 
from the similar triangles PMS and PRQ we have 


( 1 ) 


MS RQ h _ Xn — Xi 

MP ~RP’ bTl ~ TyT 

• h — 15? I y* 1 

\yr\ + \y^^ 


The value of the desired root, under the assumptions made, is 


Hence 

( 2 ) 


X Xf “|— 3/5 Xi -{- 3., 


X = a:, + 


(xj — Xi) I yi 

yi 1 + I ^2 I 


This value of x is not, however, the true value of the root, because the 
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graph of y = / (rr) is not a perfectly straight line between the points P and 
Q, It is merely a closer approximation to the true root. 

In the practical application of the regula falsi method we compute a short 
table of corresponding values of x and f(x) for equidistant values of x — 
units, tenths, hundredths, etc. Then by means of (1) we compute cor- 
rections to be applied to the previously obtained approximate values. The 
following examples should make the method clear. 


Example 1. Compute the real root of 

x logic ^ — 1.2 = 0 
correct to five decimal places. 

Solution. The short table in Example 1 of the preceding article shows 
that the root lies between 2 and 3, and that it is nearer 3. Hence we make 
out the following table and then compute the corrections by (1). 

1st 

approx. 

Diff. 


2nd 
approx. 

3rd 

approx. 

4th 

approx. 

=2.7406 + 0.u00046 
= 2.74065. 


X 

2 

1 

p 

h _lX0-6_ , 

0.83 

3 

+ 0.23 

xM =2 4 0.72 = 2.72. 

1 

0.83 

2.7 

2.8 

0.1 

— 0.04 
+ 0.05 

0.09 

^ 0.1X0.04 

0.09 

x(2) = 2.74. 

2.74 

— 0.0006 

_ 0.01 X 0.0006 _ 

2.75 

+ 0.0081 

- 0.0087 ~ 

0.01 

0.0087 

= 2.74 4 0.0007 = 2.7407. 

2.7406 

2.7407 

— 0.000039 
+ 0.000045 

0.0001 X 0.000039 
“ 0.000084 

0.0001 

0.000084 

= 0.000046. 


Remark. In examples of this kind it is necessary to u^e logarithms to 
more decimal places with each succeeding approximation. In this example 
six-place logarithms were used in the last approximation. 

Example 2. Find the real root of the equation 


3j- — cos X — 1=0. 
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Solution. In Ex. 2 of the preceding article we found the approximate 
value of this root to be 0.6. Hence we begin by computing the following 
short table of corresponding values of x and f {x) = 3x — cos .t — 1 = 

It is evident from the table that the root lies between 0.60 and 0.61. 
Hence we proceed with the first approximation by the regula falsi method. 


X 

fix) 

0 60 

-0 025 

0 61 

+0 010 

0 62 

+0 046 


1st 

X 

y 


0.60 

— 0.025 

•, 0.01 X 0.025 

hi 0.0071. 

approx. 

0.61 

+ 0.010 

0.035 

Diff. 

0.01 

0.035 

x(^) = 0.60 + 0.0071 = 0.607. 

2nd 

approx. 

0.607 

— 0.00036 

^ 0.001 X 0.00036 

0.608 

+ 0,00321 

^ ^ ^ ^ 

0.00357 

0.001 

0.00357 

= 0.000101. 

a-'-) = 0.6071. 

3rd 

approx. 

0.6071 

0.00000 

7(3 = 0. 

0.6072 

0.00035 

x(»> = 0.60710. 

0.0001 

0.00035 



65. Solution by Repeated Plotting on a Larger Scale. The following 
method is the graphical equivalent of the regula falsi method and has the 
advantage of giving a visual representation of the approximating process. 

Suppose an approximate value of the root has been found from a graph 
or otherwise. Plot on a large scale a small part of the graph oi y = f(x) 
for values of x near the desired root, so that one can sec more clearly about 
where the graph crosses the x-axis. An additional figure of the root can 
be read from this graph. Then plot on^a still larger scale a small part 
of the graph for values of x near the improved value of the root (the value 
just found), and continue the process in this manner until the root has 
been found to as many figures as desired. The following example should 
make the method clear. 

Example. Find the positive real root of 
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Solution. We first compute the value of the left member for several 
values of x, as given in table (1). This table shows that a root lies 
between 0.5 and 0.6. Iletice we plot the graph of the given equation from 
X = 0.5 to X = 0.6 and assume it to be a straight line within this interval. 
The result is Fig. 10 (a), and it shows at a glance that the root is about 
0.56 or 0.57. We therefore compute table (2) and plot the results as 


X 

fix) 

X 

fix) 

(1) 0 4 

-0 42 

(3) 0.579 

-0 001 

0 5 

-0 26 

0.580 

-t 0.003 

0 6 

+0 14 



(2) 0 56 

-0.092 

(4) 0.5793 

-0 0005 

0 57 

-0 030 

0 5794 

■fO.0003 

0 58 

-fO 003 






Fio. 10 



192 


SOLUTION OF NUMERICAL EQUATIONS 


[Chap. IX 


shown in Fig. 10 (b). This graph shows that the root is about 0.579. 
Continuing the process in this manner by computing tables (3) and (4) 
and plotting the results on still larger scales as shown in Figs. 10 (c) 
and 10 (d), we find the desired root to be a; =* 0.57936 to five figures. 

This method and the regula falsi method are particularly valuable for 
finding the roots of complicated equations such as the one solved above. 

The Newton-Raphson Method. When the derivative of f(x) is a 
simple expression and easily found, the real roots of /(x) == 0 can be 
computed, rapidly by a process called the Newton-Eaphson method. The 
underlying idea of the method is due to Newton, but the method as now 
used is due to Eaphson,* 

To derive a formula for computing real roots by this method let a 
denote an approximate value of the desired root, and let k denote the 
correction which must be applied to a to give the exact value of the root, 
so that 

X = a h. 

The equation f{x) =0 then becomes 

/(a + /0 —0. 

Expanding this by Taylor’s theorem, we have 

f{a + h) = /(a) + hfia) + ^ /"(a + eh), 

Hence 

f{a) + hfia) + ^ f"(a + eh) = 0. 

Now if h is relatively small, we may neglect the term containing 
and get the simple relation 


from which 

( 1 ) 


f(a) + hf'(a) = 0, 


h, 


f{<^ ) 

m ■ 


The improved value of the root is then 
(2) ai = a hi = a 


/(«) 
/'(a) ■ 


See Cajori*8 History of MathematicSt p. 203. 



Art. 66] 


THE NEWTON-RAPHSON METHOD 


103 


The succeeding approximations are 


a2 = ai + hn = 


/(«■) 

f'M ’ 


s= Q,., 


. . . an = a„_i 


f (an-x) ■ 


r(a,)^ 


Equation (1) is the fundamental formula in the Newton -Kaphson pro- 
cess.. Jt is evident from this formula that the larger the derivative f{x) 
the smaller is the correction which must be applied to get the correct 
value of the root. This means that when the graph is nearly vertical 
where it crosses the x-axis the correct value of the root can be found with 
great rapidity and \eiy little labor. If, on the other hand, the numerical 
value of the derivative /'(.r) should be small in the neighborhood of the root, 
the values of h given by (1) would be large and the computation of the 
root by tins mothod would be a slow process or might even fail altogether. 
The New^ton-llaphson method should never be used when the graph of 
f(x) is nearly horizontal wdiere it crosses the j-axis. The process will 
evidently fail if f(x) = 0 in the neighborhood of the root. In such cases 
the regula falsi method should be used. 

We shall now apply the Newton-Eaphson method to two examples. 


Example 1. Compute to four decimal places the real root of 

X- 4l sin a: »= 0. 

SolulioTt. Since the term a** is positive for all real values of x, it is 
evident that the equation will be satisfied only by a negative value of x. 
We find from a graph that an approximate value of the root is — 1.9. 
Since f{x) = ^ sin a: and f{x) =* 2a: -j- 4 cos x, we have from (1) 


_ _ _(— 1.9)= + 4 sin (— 1.9) 

~ 2(— 1.9) + 4 cos (—1.9) ~ 

== — 0.03. 

= — 1.9 — 0.03 = — 1.93. 

(_ 1.93)2^ 4 sin (—1.93) 
““ 2(— 1.93) + 4 cos (— 1 .93) 

__ 0.0038. 

ao = — 1,9338. 


3.01 — 3.78 
— 3.8 — 1.293 


— 0.0198 

— 5.266 


This result is correct to its last figure, as will be shown later. 



194 


SOLUTION OF NUMERICAL EQUATIONS 


[Chap. IX 


Example 2. Find by the Ncwton-Raphson method the real root of 

3x — cos X — 1 = 0. 

Solution. Here 

f[x) = 3x — cos X — 
f(x) = 3 -f- sin X. 

We found graphically (Fig. 8) that the approximate value of the root is 
0.61. Hence 

_ _ 3(0.61) — cos (0 .61) — 1 0.010 

^ ' ~~ 3 + sin (0.61 ) 3.5: 

= — 0.00290. 

a, = 0.61 — 0.0029 = 0.6071. 

3(0.6071) — cos(0.6071) — 1 
‘“3 + sin (0.6071) 

= 0.00000381. 

.*. a, = 0.60710381. 

This result also is true to its last ngure. 

It will be observed that the root was obtained to a liigher degree of 
accuracy and with less labor by this method than by the regula falsi 
method. 

67. Geometric Significance of the Newton-Raphson Method. I'he regula 
falsi method assumes that the grajih of the given function is replaced by 
the chord joining (xi, yi) and (xs, t/^). No such geometric assumption 
was made in deriving the formula for computing the roots by the Newton- 
Eaphson method, but the formula has a simple geometric significance 
nevertheless. 

Let Fig. 11 represent a magnified view of the graph of y = /(x) where 
it crosses the x-axis. Suppose we draw a tangent from the point P whose 
abscissa is a. This tangent will intersect the x-axis in some point T. 
Then let us draw another tangent from P^ whose abscissa is OT. This 
tangent will meet the x-axis in some point 7\ between T and S. Then 
we may draw a third tangent from 1^2 whose abscissa is OTi, this tangent 
cutting the x-axis at a point Tz b< tween Ti and S, and so on. It is 
evident intuitionally that if the curvature of the graph does not change 
sign between P and S the points T, 7\, T 2 , ' ' will approach the point 

'S as a limit; that is^ the intercepts OT, OT^, 0 X 2 , * * * will approach the 
intercept OS as a limit. But 08 represents the real root of the equation 
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whose graph is drawn. Hence the quantities OT,OTi,OT2y‘ • * are 
successive approximations to the desired root. This is the geometric 
significance of the Newton-Raphson process. 



To derive the fundamental formula from this figure let MT = hi, 
TTi = ho, etc. The slope of the grapli at P is f'(a). But from the figure 
we have 

PM = f{a), and slope at P = tan /_XTP = — . 

Hence 


f\a) = - 


m 

hi ' 


or hi = 


f(a) 

fia) ’ 


which is the fundamental formula of the Xewlon-Ilaphson method. From 
the triangle PiTTi we find in exactly the same way 


h, = 


fYn\) • 


From the preceding discussion it is evident that in the Newton-Raphson 
method the gra})h of tlu' given function is replaced by a tangent at each 
successive step in the approximation process. 
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The Newton-Eaphson method should not be used when either f(x) = 0 
or f'(x) — 0 near the desired root. Use the method of enlarged graphs 
(Art. 65) in such cases. 

•^68. The Inherent Error in the Newton-Raphson Method. If a is an 

approximate value of a root of = 0 and h is the necessary correction, 
so that f{a-\-h) = 0 , then we have by Art. 66 

(1) f{a) + hf{a) + -- f"(a f eh) = 0, 0 < 0 < 1. 

In the Newton-Eaphson method we neglected the term involving and 
got an approximate value hi from the equation 

(2) f(a) + h,f(a) = 0. 

Subtracting (2) from (1), we have 


( 3 ) 


(h~K)fXa)+^r(a + eh) 


0 . 


■ h,==~h- 


r(a + eh) 

2f(a) 


Now since h is the true value of the required correction and hi is its 
approximate value, it is plain that h — h, is the error in The error in 
hi is thus given by (3). Let M denote the maximum value of f"{x) in 
the neighborhood of a hi. Then 


( 4 ) 


h—h, 


mi 

2f{a) ■ 


Our next problem is to express this error in terms of the known quantity hi. 
Clearing (4) of fractions and transposing, we have 


Mh^ + 2f'(a)h =='2f(a)hi. 

_ —rM + v[rw + ^^Ai r(a)hi 





Now expanding the quantity [1 + 2Mhi/f(a)y^ by the binomial theorem, 
we have 
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- |- 

Mh^ 

2f(a) + 2[f (a)]* ■ ■ ■ • 

Hence 


1 I 1 

2 [na)y 2 [/'(a)]»;J 

1 N 

f(a) + 2 [fia)y) 


(5) 


J/A,® M’‘h 
2f(a) + 2[f(a)]- 


Since is always a small decimal, it is evident that the principal part 
of the error is contained in the first term on the right-hand side of (5), 
so that we may neglect the term involving The formula for the error 

thus reduces to 


( 6 ) 




2f(aj 


This is the error in a^. The error in On is therefore 


(7) 




2f(an..) 


Now in most equations which one w'ould solve by the Newton-Raphson 
method the quantity M/2f(a) is not greater than 1. Suppose, therefore, 
that I M/2f(cUn_i)\ ^ 1. Then (7) reduces to 

(8) I I ^ hn^. 


This result is most important; for it tells us that if hn begins with m 
zeros when expressed as a decimal fraction, then hn^ begins with 2m zeros. 
This means that when the first significant figure in h is less than 7, we 
may safely carry the division of /(an-i)//'(an-i) to 2m decimal places; for 
the error in the quotient will be less than half a unit in the 2mth decimal 
place. Stated otherwise, the number of reliable significant figures in h is 
equal to the number of zeros between the decimal point and first significant 
figure, provided the number of reliable figures in both f(cin-i) and f(an.i) 
js as great as the number of zeros preceding the first significant figure in h. 


Hence in finding the correction h from the relation 7i = — 


m 


'r(a)' 

divisions of f{a) by f(a) should be carried out to only one more significant 
figure than the number of zeros between the decimal point and first 
significant figure. 

We thus have a simple method for determining the accuracy of the roots 
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found by the Newton-Eaphson method, and this fact makes this method 
much superior to the regula falsi method when the root is desired to 
several decimal places. 

It is now clear why we were able to say in Exs. 1 and 2 of Art. 66 that 
the results obtained were true to the last figure in each case. 

69. A Special Procedure for Algebraic Equations. Many algebraic 
equations can be solved by first removing some of the known real roots 
by synthetic division and then solving the resulting depressed equation 
by the easiest method available. For example, if the depressed equation 
is a quadratic, it can always be solved by the quadratic formula. The 
following example illustrates the method. 

Example. Find all the roots of 

— 26^2 + 49a: — 25 = 0 

Solution. Since the graph of y = f{x) == — 26a:- + 49 j: — 25 crosses 

the y-axis at (0, — 25), it is plain that the given equation has at least 
two real roots. By assigning integral values to x and computing the 
corresponding values of f(x), we find that these roots are near — 6 and 4, 
respectively. They are found more accurately by the Newton-Eaphson 
method to be — 5.916 and 3.876. Now removing these roots from the 
given equation by synthetic division, we have 

1 0 —26 49 —25 

— 5.916 34.999 — 53.238 25.072 (— 5.916 

1 — 5.916 8.999 —4.238 (3.876 

3.876 —7.907 4.233 

1 1-2.040 1.092 

Neglecting the remainder terms in each division, we have 

2.040a: + 1.092 = 0 

for the depressed equation. Solving this by the quadratic formula, we get 

a: = 1.020 zt 0.227t 

as the remaining roots. As a check on the computation, we have 

Sum of roots = 0.000, 

Product of roots = — 25.038, 

which is a satisfactory check. 
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It is sometimes desirable to know the nature of the roots of a cubic or 
quartic equation before attempting to find them. For a thorough discussion 
of the nature of the roots of these equations, see Burnside and Panton’s 
Theory of Equations^ Vol. 1. 

70. The Method of Iteration. When a numerical equation f{x) =0 
can be expressed in the form 

(1) x = <f>{x), 

the real roots can be found by the process of iteration. This is the method 
which was used for inverse interpolation in Art. 29. The process is this: 
We find from a graph or otlierwise an approximate value Xq of the desired 
root. We then substitute this in the right-hand memher of (1) and get 
a better approximation x^^\ given by the equation 

X^^^ = <t>(Xa). 

Then the succeeding approximations are 


Q^(n) _ ) . 

We shall apply the pr'Kt^ss to two examples. 

Example 1. Find by ihe method of iteration a real root of 

2^* — log.o " 

Solution. The given equation can be written in the form 

4- 7). 

We find from the intersection of the graphs y[ = 2x — 7 and i/o = logio x 
tliat an a})})roximate value of the root is 3.8. Hence we have 

(log 3.8 -f 7) = 3.79, 
a;(2) = J(log 3.79 + 7) = 3.7893, 

= ^(log 3.7893 + 7) = 3.7893. 

Since x^^^ is the same as we do not repeat the process but take 3.7893 
as the correct result to five figures. The iteration process is the shortest 
and easiest method for working this example. 

Example 2. The method of iteration is especially useful for finding 
the real roots of an equation given in the form of an infinite series. To 
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find an expression for the probable error (see Art. 133) of a single 
measurement of a set, one procedure is to find the real root of the following 
equation (see page 413) : 


or 

(a) 


^ 3 10 42 216 1320 + ’ ‘ “ 0.4431135, 


^ 3 10 42 216 1320’ 


0.4431135. 


We shall now find the value of p to six decimal places. 

Solution. Neglecting all powers of p higher than the first, we find an 
approximate value of p to be 0.44. Hence we start with this value and 
substitute it in the right-hand member of (a). The result is 


(0.44)3 (0.44)® , (0.44)^ 

^ 3 1 ^+“^ 

= 0.4699 = 0.47, say. 

Then the second approxiinalion is 

(0.47)» (0.47)=> tO.47)' 

^ 3 10 42' 

= 0.47554 = 0.476, say. 


(0.44)“ 

'216' 


(0.44)“ 

1320 


+ 0.4431 


(0.47)“ 

216 


(0.47)“ 

1320 


+ 0.44311 


Writing (a) in the form 


P = 


we find the succeeding af)proximations to be 

p(^) = 4,(0A76) =0.4767, 
p(^) =c/,(0.4767) =0.47689, 

=<^>(0.47689) = 0.476927, 
p(6) =<^(0.476927) = 0.476934, 

^(7) =c^(0.476934) = 0.476936. 

This last value is correct to its last figure.* 

The reader wull observe that the iteration process converges slowly in 
this example. This is due to the nature of the given equation. In Ex. 1 the 
convergence was rapid. 

Note. Usually there are two or more w^ays in which an equation f{x) — 0 
can be wTitten in the form x = (l}{x). It is not a matter of indifference 
as to which way it is written before starting the iteration process, for in 

•The value of p correct to ten decimal places is 0.4769302762. 
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some forms the process will not converge at all. An example of this is 
given in Art. 74. 

■^71. Convergence of the Iteration Process. We shall now determine 
the condition under 'which the iteration process converges. The true value 
of the root satisfies the equation 

x = <l>{x), 

and the first approximation satisfies 

=Kf>(xo). 

Subtracting this equation from the j)receding, we have 

(1) .r — 2:0) =if,{x) -- </>(2:o). 

By the theorem of mean value Ihe riglit-hand member of (1) can be 
written 

<l>{x) - - <f>(x,y) = (2: — .ro)<^'(^c), 2*0 ^ ^ 2*. 

Hence (1) becomes 

X — xo) = (x — Xo)<t>'(io)- 

A similar equation holds for all succeeding apjnoximations, so that 


2; — 2^^^ ■--= (.r — 

l\Iullif)lyi]ig together all these equations, member for member^ and dividing 
Ihe result through by th(‘ ('omnion factors x — x — x^-),- ■ ./• — 

we get 

X- (x 2 -o)<^)'( 4 )</>'(si) ■ ■ 

Now if the maximum absolute value of </>'(2:) is less than 1 throughout the 
interval (2*0, x), so that each of ihe quantities etc. is not 

great(‘r than a jirojier fraction w, we get from (2) 

(3) I X — xO*) I ^ I X — .ro I ???/'. 

Since the right-hand member of (3) approaches zero as 71 becomes la'ge, 
we can make the error x — x^”’ as small as we please by repeating the 
iteration process a sunici(uit nuinb(‘r of times. 

The condition, then, for convergence is that | <t>'(x) | be less than 1 in the 
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than 1 in the neighborhood of the desired root, the smaller the value of 
Kt>'(x) the more rapid the eonvergenec. This condition was satisfied in 
Examples 1 and 2 above. 

72. Geometry of the Iteration Process. It is instructive to look at 
the geometric picture of the iteration process. For simplicity we denote 
the successive approximations to the root by Xq, Xi, Xo, ■ • ',Xn. Then 
the relations 

Xi =<f,(Xo) 

X2 = 

X3=<t>{x2), etc., 

can be pictured as points by the following geometric construction : 

Draw the graphs of = x and « <^{x), as shown in Figure 12. Since 
I \ 1 convergence, the inclination of the curve = <t>{x) must 

be less than 45° in the neighborhood of Xq. This fact has been observed in 
constructing the graph. 
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Now to trace the convergence of the iteration process, draw the ordinate 
Then from the point Fq draw a line parallel to OX until it inter- 
sects the line y^ = x at the point Oi[xi, <^(xo) ]. Note that this point 
is the geometric representation of the first iteration equation 
Then draw QiPi, P1Q2, Q2P2, P^Qzy etc., as indicated by the arrows in the 
figure. The points Q2y Qa • ‘ thus approach the point of intersection 
of the curves 1/1 — x and y2 — <f>(x) as the iteration proceeds. Note that 
the coordinates of these ^’s satisfy the corresponding iteration equations. 

The reader should draw a curve y2 =i>{x) with inclination greater than 
45 ° in the neighborhood of Xq and then proceed with the construction as 
outlined above. He will find that the points Q2, etc. recede farther and 
farther away from the intersection point of the graphs and that the succes- 
sive approximations Xi, X2, etc. get worse as the iteration proceeds. 


72a. Convergence of the Newton-Raf^hson Method. 

Haphson formula 


( 1 ) 


On+i ttn 


fjOn) 

f(an) 


The Newton- 


shows that the Newton-Raphson method is really an iteration method; 
and since ( 1 ) can be written symbolically in the form 


Orn+i 

or 


we see at once from Art. 71 that the Newton-Raphson method converges 
when 

I I < 1. 

Hence from ( 1 ) we have 




d / f(x)\ f{an)r{an) 

dx\ r(*)A=.. [/'(a.)]* • 


The sufficient condition for convergence is therefore 


or 

( 2 ) \f{an)r(a.)\<[r(an)V- 


II. SIMULTANEOUS EQUATIONS IN SEVERAL UNKNOWNS 

The real roots of simultaneous algebraic and transcendental equations in 
several unknowns can be found either by the Newton-Raphson method or 
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by the method of iteration. We shall give an outline of each method for 
the cases of two unknowns and three unknowns. The reader will have no 
difficulty in extending both methods to the case of any number of unknowns 
should the necessity arise for doing so. 

73. The Newton-Raphson Method for Simultaneous Equations. Let 

us consider first the case of two equations in two unknowns. Let the given 
equations be 

(1) <^(x, y)==0, 

( 2 ) il,{x,y)^0. 

Now if Xq, yo be approximate values of a pair of roots and h, k be corrections, 
so that 

X = Xo -|- h, 

y = Vo + 

then (1) and (2) become 

(3) </>(^o yo =0, 

(4) ^(^0 + ^0 + ^) = 

Expanding (3) and (4) by Tay’or’s theorem for a function of two variables, 
we have 

(5) 4»(^o + 2/o + == yo) h ^ ( Sy )o 

-1- terms in higher powers of h and fc = 0. 

( 6 ) + h , 2/0 4 " yo ) + ^ (^^0 

4- terms in higher {>owers of h and k == 0. 

Now since h and k are reJatively small, we neglect their squares, products, 
and higher powers, and then (5) and (6) become simply 

( 7 ) + ( 3 ^).“"" 

(S) 

Solving these by determinants, we find the first corrections to be 

-»A(xo,y,) 

D 




Art. 73] 


SIMULTANEOUS EQUATIONS 


205 


( 10 ) 

where 

( 11 ) 



Additional corrections can be found by repeated applications of these 
formulas with the improved values of x and y substituted at each step. 

The notation {d<f)/dx)o m(*ans the value of d(t>/dx when Xq and yo are 
substituted fo^ x and y. Similarly, (0</>/0.T)i means the value of d<p/dx 
when x = x^^*, y == j so on. 

In the case of three e(juations in three unknowns, 


4,(x, y,z) = 0, 
ip(x, y, z) = 0, 

y,^) = 0 , 


let h, ky ly denote cor r^*ct ions to the approximate values Xq, yo, Zq, respec- 
tively. Then proceeding exactly as in the case of two equations, we get 
the three simple equations 

y,, + h (^) + (^) + I (If 0, 

yo, z„)-\-h (If ) + Jc (If ) + I (^) - 0> 

x(^«, Vo, z,) + h (1^ ) + fc (If ) + ^ (^) = 0’ 

for determining the first corrections hi, ki, The process may be repeated 

as many times as desired. 

We shall now apply tliis method to a pair of simult^ineous equations, 
one transcendental and the otlier algebraic. 

Example. Compute by the Newton-Ilaphson method a real solution of 
the equations 

( X -f 3 logxo X — y^ = 0, 

^2x2 — xy — 5x -f 1 = 0. 
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Solution. On plotting the graphs of these equations on the same set 
of axes, we find that they intersect at the points (1.4, — 1.6) and (3.4, 2.2). 
We shall compute the second set of values correct to four decimal places. 
Let 

( 1 ) =-x + S\og,oX — y^, 

( 2 ) ^2x^ — xy — 5x+ 1 . 

Then 

^ = 14- , where M = 0.43429, 

dx X 


0</> 

dy 


2y, 



0|/' 

dy 


= — X. 


Now since Xq = 3.4, yo = 2.2, we have 


<#>(a:o, yo) == 0-1545, \fi{xo,yo)’= — 0.72, 



4.4, 



= 6.4, 


Substituting these values in (9), (10), (11), we find 
A. —0.157, A:, — 0.085. 

Hence 

lO) = 3.4 -I- 0.157 — 3.557, — 2.285. 

Now substituting a:**’ and y*'* for x and y in <f>{x,y), f(a:, y), d<ft/dx, 
etc., we get 

4)(i'*>, y<*>) 0.011, ./-(xO), y(*) ) 0.3945, 



Substituting these in (11), (9), (10), we get 

hi 0.0685, — — 0.0229. 


Hence 


x<*> — 3.4885, 


y'*) — 2.2621. 
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Repeating the computation with these improved values of x and y. we 
find 

hs 0.0013, fcs 0.000561. 


Hence the third approximations are 

= 3 . 4782 , y 
and these are correct to the last figure. 


= 2 . 26154 , 


74. The Method of Iteration for Simultaneous Equations. In the case 
of two equations 

we first write the given equations in the forms 

x = F,(x,y), 
y~~F^{x,y). 

Then if Xo, yo be the approximate values of a pair of roots, improved values 
are found by the steps indicated below : 

Ist (a:*** — PiCaio, yo), 

approx. |y<'> — yo) ; 

2nd =Fi(x<>>,y<»), 

approx. |y**’ y'*’) ; 

etc. 

If we are given three equations 

<f>{x,y,z) —0, 

'l'(x,y,z) =0, 

X{x,y,z) —0, 

we would first write them in the forms 


x==Ft{x,y,z), 
y = F^{x, y, z), 
z -= Fi{x, y, z). 


The successive steps in the computation would then be: 


Ist 

approximation 


=;’j(xo, yo, 2o), 

y<i*=f;’,(x<^yo,z.), 

*(i)=i;’,(x‘»,y<*>,Zo); 
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2nd 

approximation 


etc. 


We shall now apply the interation process to the pair of equations which 
we have already solved (for one pair of roots) by theNewton-Eaphsou 
method : 

4‘{^,y) = a: + 3 logio a: — 
il/(x, y) = 2x^ — xy — 6x + 1. 


Solution. We start with the approximate values Xo = 3.4, yo =« 2.2, as 
indicated by the intersection of the graphs. In our next step we are 
confronted with several possibilities, for the two equations can be writen 
in the forms x = Fi{x,y), y = F^ix, y) in several ways. In the absence 
of further information we start out with the simplest forms, namely 


x^y^ — 3 logic X, 
y=~ + 2x — 5. 

Then we have 


a;<'> = {2.2y — 3 log,o 3.4 = 3.25, 

y'’' = 3-27; = 

= (1.81)2-- 3 logi„(3.25) _ J 74 ^ ^ 

= “ +2(1.74) —5 ==0.£)5. 

These values of x and y are evidently getting worse with each application 
of the iteration process. We must therefore write the given equations in 
some other form before attempting the jteration process again. 

Without trying all possible forms we make a fresh start with the only 
forms that will make the process converge, namely 

,^yj^Sy±IEEl^ 


y = Va; + 3 logioi. 
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Then the successive approximations are 


= 


Vi 


4(2.2 -f- 5) -- ] 


== 3 -120, 


yd) = V 3.426 -h 3 Iog,« 3.426 = 2.243 ; 


= Vi 


426(2.243 5) — ] 


= 3.4ol, 


yi2) _ V3.451 3 logjo 3.451 = 2.2505; 

xts) = 3.466, = 2.255; 

= 3.475^ y(4) _ 2.258; 


= 3.480, 
= 3.483, 


= 2.259; 

y(6) = 2.260. 


Here it is (‘vident that the iteration process converges very slowly in this 
example, for after having applied the process six times we have added 
only one reliable figure to the approximate roots with which we started. 

This example brings oat two important facts in connection with the 
method of iteration. The first is that we must not start out blindly in 
working a problem by this method, for instead of improving the roots at 
each step we might make them decidedly worse. The second important 
fact brought out is that the iteration process should not be applied at all 
in some examples, for the convergence might be too slow, as was the case 
above. All this leads us to a consideration of the conditions under which 
the process converges. Having these conditions at hand, we can decide 
in advance as to the advisability of attempting a problem by iteration. 

75. Convergence of the Iteration Process in the Case of Several 
Unknowns. To find the sufficient conditions for convergence in the case 
of two equations, we write them in the forms 

x==Fi{x,y), 
y = F^{x,y). 

These equations are satisfied by the exact values of the pair of roots x, y. 
The first approximations satisfy the equations 

= /^(xo, 2/o), 
yd) = yo)- 

Subtracting these equations from the corresponding equations above, we 
have 

(1) X — x^^^ = i^i(x, y) — /^i(xo, yo), 
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(2) y — y^^^-~Pi(x,y)—F2{xo,yo). 


Now applying to the right-hand side of the first equation the theorem of 
mean value for a function of two variables, we have 

f) P 

Fi{x,y) —F,{Xo,yo) = {x — Xo) -I- (y -y„) , 

where 

ay?, dF,[x„ + e(x--x„),y„ + e(y — y„)\ 

and 

a/?, _ af,[a:o + 6(x — x„), y„ + 0{y — y,,)] 
dy dy 

In a similar manner we get 

F 2 {x,y) —F^ixcyo) = {x — x„) ^ -f (y — yo) • 

Substituting these expressions for the right-hand members of (1) and 
(2), we get 

= (X--X,) ^ + (y-y„) ^ , 

y — yii) = (x — x„) + (y — yo) ^ . 

Adding these two equations and considering only the absolute values of 
the several quantities, we have 


(3) 


rd) 


+ I y- 


,(i) 


+ 


, 1 

0y?. 

+ 

dp2 

X To ! < 

dx 

dx 

. { 1 

df\ 

+ 

9/?2 

0 

1 

9y 

dy 


Now let the maximum value of either | dF^/dx | | dFz/dx | or 

I dFi/dy I -j- I ^Fz/dy | be a proper fraction m for all points in the region 
( 2 : 0 , 3 :) and (yo^y). Then (3) becomes 

I a;_a;(i) I _|_ I y — y<») I < m{ I a: — lo I + I » — yo I } . 

This relation holds for the first approximation. For the succeeding 
approximations we have the similar relations 

I X — a:'*» I -f I y — y‘*> | g m{ | x — a:<'> | -f | y — y<') | ), 

I X — a:'*' I -|- I y — y<*> I ^ i x — a:<“> | -f | y — y<*> | }, 


\ X — a:*"* I -|- |y — y'"> | \ x — | -j- | y — y (»-») | 

Now multiplying together all these inequalities, member for member, 
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and dividing through by the common factors { | x — | + | y — 

{ I x — I + I 3/ — I }> we get 

I X — I + I y — | g m"{ \x — a^o [ + | y — yo | }• 

Since m is a proper fraction, it is clear that we can make the right- 
hand member of this inequality as small as we please by repeating the 
iteration process a sufficient number of times. This means that the errors 
I X — x^*'^ I and | y — y^"^ | can be made as small as we like. 

The iteration jiroccss for two unkno>yns th(‘refore converges when the 
two conditions | dF^/dx | + | dF^/dx | < 1 and | dF^/dy | + | dF-^/dy | < 1 
hold for all points in the neighborhood of (x,,, yo)* In order for the con- 
vergence to be rapid enough to make the method advisable in any given 
problem it is nec^essary that each of the quantities | dFi/dx \ + | dF 2 /dx | 
and I dFy/dy | -j- | dF^/dy | be much less than 1. 

We are now able to see why the convergence was so slow in the example 
which we attempted to work by the iteration process in Art. 74. For that 
example the values of the quantities named above are 

= 0.521 + 0.304 «= 0.825, 

0.162 + 0 = 0.1G2. 

The first is much too large for rapid convergence. 

EXERCISES IX 


[ 0F. , dj\ 

1 dx dx 

dF, , dF., 

dy 0y 


1. Find graphically or otherwise the approximate value of a real root 
of the equation 


2x — logic a: — 7. 


2. Find the approximate value of a real root of 

. , 10 

X sinh — — 15 0. 

X 

3. Compute to four decimal places by the interpolation method the root 
found afiproximately in Exercise 1 above. 

4 . Do the same for the root found approxirnattdy in Exercise 2. 

5. Find to six decimal places by the Newton- Kaphson method a real 
root of 


2x — 3 sin X — 5 =* 0. 
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6 . Solve a;*=«0.21sin (0.5 + x) by the iteration process. 

7 . Find to three decimal places the smallest positive root of 

X* — J— 2x =• 6. 

8 . Find the smallest positive root of 

X tan X «= 1.28. 

9. Find to five decimal places a root of 

X logic x = — 0.125. 

10 . Find all the roots of 

3x^ + 5x — 40 = 0. 

11 . Compute to six decimal places a root of 

66 — o sinii 6^0, 


12 . Find the smallest root of 

x^ x^ x^ 

13 . Find a real solution of 

4.2x2 ^ 8.8y2«. 1.43^ 

{x — l,2y -f (y_o.G)2- 1. 

14 . Find to five decimal places a solution of 

sinx*=y — 1.32, 
cosy — X — 0.85. 

15. Find all the roots of 


dx-' 





CHAPTEE X 


GRAEFFE’S ROOT-SQUARING METHOD FOR 
SOLVING ALGEBRAIC EQUATIONS 

76. Introduction. The methods given in the preceding chapter, except 
that of Art. 69, are applicable only for finding the real roots of numerical 
equations. It is sometimes necessary to find also the complex roots of 
algebraic equations. In studying the stability of airplanes, for example, 
it is necessary to solve linear differential equations with constant coetTicients. 
The solution of such a differential equation is effected, as is well known, by 
first solving an algebraic equation whose degree is equal to the order of 
the given differential equation. The algebraic equations which arise in 
stability theory are usually of the fourth, sixth, or eighth degree. A pair 
of complex roots indicates an oscillation, tlie real part of the root giving 
the damping factor and the imaginary part tlie period of oscillation. 

No short and simple method exists for finding the complex roots of 
algebraic equations of high degree. Probably the root-squaring method of 
Graeffe * is the best to use in most cases. This ineihod gives all the roots 
at once, both real and complex. 

77. Principle of the Method. The underlying principle of Graeffe’s 

method is this: The given equation is transformed into another whose roots 
are high powers of those of the original equation. The roots of the trans- 
formed equation are widely separated, and because of this fact are easily 
found. For example, if two of the roots of the original equation are 3 and 
2, the corresponding roots of the transformed ecjuation are 3'" and 2^, 
where m is the power to which the roots of the given equation have been 
raised. Thus, if m = 64, we have 3^^^ == 10^^ 2*'”* = 10^*' The two 

roots of the given equation were of the same order of magnitude, but in 
the transformed equation the larger root is more than a hundred billion 
times as large as the smaller one. »Stated otherwise, the ratio of the 
roots in the given equation is but in the transformed e(piation it is 
IQ19 266 / 20^0 530 _ < 0.00000000001. Tlic smaller root 

in the transformed equation is therefore negligible in conqiarison with the 
larger one. The roots of the transformed equation are said to be separated 

* Auflostitig der hoherrn numerischrn Olcichurtgen, Zurich (18.37). 
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when the ratio of any root to the next larger is negligible in comparison 
with unity. 

78. The Root-Squaring Process. The transformed equation is obtained 
by repeated application of a root-squaring process. The first application 
of this process transforms the given equation into another whose roots are 
the squares of those of the original equation. This second equation is then 
transformed into a third equation whose roots are the squares of those 
of the second, and therefore the fourth powers of those of the original 
equation. The root-squaring process is continued in this manner until 
the roots of the last transformed equation are completely separated. 

We shall now explain the root-squaring process and show the method of 
applying it. 

Let the given equation be 

(78. 1) f{x) — aoX^ -f- a^x^'^ -f- + ’ * ‘ + + On — 0. 

Then if Xi, arj, • • • Xn be the roots of this equation, we can write it in the 
equivalent form 

(1) f{x) —Ooix Xi){x Xi) (x Xs) ’ • ' {x Xn) — 0. 

Now let us multiply (1) by the function 

( 2 ) {—l)”f{—x) = {—l)^ao(—x — Xi){—x — X 2 )- • {—X — Xn) 

— ao{x + Xi) {x + Xz) ’ • ■ (X + Xn). 

The result is 

(78.2) (—l)»f(—x)f(x) =a^^{x^ — x^^){x^ — x^) • • • {x^ — Xn^). 

Let x ^ »— y. Then (78. 2) becomes 

( 3 ) ^{y) —ao^{y — x,^){y — X2^) • * * (y — Xn^) — 0 . 

The roots of this equation are Xi^, Xz^, * • • Xn^ and are thus the squares 
of the roots of the given equation (78. 1). Hence to form an equation 
whose roots are the squares of those of /(x) « 0, we merely multiply 

This multiplication can be carried out in a simple routine manner, as 
we shall now show. Let us first consider the sixth-degree equation 

f(^x) — aoX^ + UiX® + azx* 4" <hx^ + a.^x^ -f a^x 4- ao — 0. 

Then 

( — 1 ) ®/( — x) — UoX® — axX® 4- — ttax* 4 “ a^x^ — a^x 4- a^. 


By actual multiplication we find 
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(-!)•/(-*)/(*) -a„V»-a,“ 

X^^ + 02“ 

a;® — fla* 

+ 2O0O2 

““ 2ox03 

20204 


+ 2O0O4 

— 2 fli 05 



+ 2aoO0 


+ 2d2da 

Let us consider next a seventh -degree equation, 


-f- 2^14^0 


a?* + ttfl* = 0. 


f(x) «= doX"^ -f- diX^ -f dzX^ -|- daX* -f d^X^ + + ^6^ + 07—0. 

Then 

( — 1)7( — *= ^0^^ — Oi^® + 02^^® — ClraX* + 040;® — diX^ + deX — dj. 

Multiplying these equations together in the ordinary manner, as before, 
we find 


(5) (— 1)7(— a:)/(x)=-aoV‘ — a,* 

a:^* + 02* 

I'" — 0,* 

+ 2ooOo 

— 201O3 

+ 202O4 


+ 2O0O4 

2oiO0 



+ 2OOO0 


+ 04* I a;« — 00* 


2O3O0 
-|— 2O2O0 
— 201O7 


+ 20400 
203O7 


+ Oo* I a;* — Or* — 0 . 
— 205O7 I 


A glance at equations (4) and (5) shows that the law of formation of 
the coefficients in the squared equation is the same whether the degree of 
the given equation be even or odd. In practice the multiplication is carried 
out with detached coefficients as indicated below : 


Oo 

Oi 

— Oi 

03 

02 

Os 

03 

O4 

O5 ■ • • 

— Ob • • • 

Oo* 

— Oi* 

02* 

— Os* 

O 4 * 

— Ob* - • • 


+ 2O0O2 

20103 

20204 

2O3O5 

+ 2O4O0 



+ 2O0O4 

— 2oiOo 

+ 2O2O6 , 

— 20', 07 • • • 




+ 2ooa0 

— 2 oia 7 

+ 2 n,n ‘ • 





+ 2ao08 

— 2a,a.j • 






+ 20oOio ■ 

bo 

b. 

bo 

bo 

bo 

bo 
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The coefficients in the new equation are the sums ho, hi, hz, ' ' hn of the 

several columns in the scheme above. These coefficients can evidently be 
written down according to the following rule : 

1. The numhers in the top row are the squares of the coefficients directly 
above them, with alternating signs — the second, fourth, sixth, etc, squared 
numhers being negative, 

2. The quantities directly under these squared numhers are the doubled 
products of the coefficients equally removed from the one directly overhead, 
the first being twice the product of the two coefficients adjacent to the one 
overhead, the second the doubled produce of the next two equally removed 
coefficients, etc, 

3. The signs of the doubled products are changed altcrnaiely in going 
along the rows and also in going down the columns, the sign of the first 
doubled product in each row not being changed. 

We shall now apply Graeffe’s method to three cases of algebraic equations. 

79. Case I. Roots all Real and Unequal. Since tlje relations between 
the roots Xi, x^, ' ’ Xn and coefficients- a^, ai,' • • an of the general equation 

of the nth degree 

a^x^ ~|- -j- • • • an-iX = 0 

are 

—L == (^Xi Xz ' ' ■ + ^n) , 

— = + {XiXz + XiX^ + • ■), 

Ui) 

— = {XiXzX^ + XiXzXi‘ • •), 

Uq 


-- = (- l)^^XiX 2 ’ ’ ' Xny 

an 

it follows that the roots Xi'^,X 2 ”\- • - Xn”l and coefficients ho,h^,- • • of 
the final transformed equation 

bo{x^)^ + b,{x^)^-^ • - - + hn^,x^ + bn = 0 

are connected by tlie corresponding relations 


^ (3:,'" + X2’» + 


■ + Xn”') 
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&2 ! 2*0*^ 7* \ 

-^= + xr-r,"' + ■ = xrx,"'l i + ^ + -i- + . • • ) , 

Oo \ Xj" Xi” / 

•^ = — + xrX2”'Xt”' + • • ■ ) = — Xi”'X2”'X3”' f 1 + ^ + • • • 

Uq \ 


■^= {—lYXjTXi”' • • Xn". 

Oq 

Now if the order of magnitude of the roots is 


I 2^1 I > I 2:2 I > I Xg I • • ■ > I Xn I , 

it is evident that when the roots are sufhciently separated the ratios 
etc. are negligible in comparison with unity. Hence 
the relations between roots and coefTicients in the final transformed equa- 
tion are 

hi ho ho 

___ - /IT fn Z. _ /T Ifl/v* fn !_ ___ /7- Ttlnr mrr 

j *^1 ) 7 Xi X2 f 7 Xj X2 X3 f 

0^) Oq Oq 

^- = (— 1 ) "Xj’"a;2’"X3"' • • XrT. 


Dividing each of these equations after the first by the preceding equation, 
we obtain 


h 

hx 



^3” 


hn 

hn-. 


= Xn^. 


Hence from these and the equation &]/&o = — 

( 79 . 1 ) hoxr + hi = 0 , hiXo^^ + ho = 0 , + 63 = 0 , • • * 

hn-iXn^ + &n = 0. 


The root-squaring process has thus broken up the original equation into 
n simple equations from which the desired roots can be found with ease. 

The question naturally arises as to how many root-squarings are necessary 
to break up the original equation into linear fragments. The answer is 
that the required number of squarings depends upon ^1) the ratios of 
the roots of the given equation and (2) the number of significant figures 
desired in the computed roots. Since the required roots, and therefore their 
ratios, are not known in advance, it is not possible to determine beforehand 
just how many times the root-squaring process must be repeated. This, 
however, is a matter of no importance, for in practice we continue the root- 
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squaring process until the doubled products in the second row have no effect 
on the coefficients of the next transformed equation. 

Since the coefficients in the given equation are not in general all positive, 
the signs of the doubled products will not occur in regular order as in the 
literal equations which we used to illustrate the root-squaring process. The 
possibilities of making a mistake in the signs of these products are great, 
and therefore some scheme should be adopted to prevent such mistakes. As 
a convenient notation for reminding us at each step as to whether or not 
the sign is to be changed we shall write a " c ’’ after each term in which the 
sign is to be changed and an ^^n^^ (for no change) after each term where 
the sign is not to be changed. 

Furthermore, as the root-squaring process necessarily increases the coeffi- 
cients in the transformed equations until they become enormously large 
numbers, we shall always write these coefficients as simple numbers multi- 
plied by powers of 10. 

Finally, in the successive transformations of the equations by the root- 
squaring process, we shall not write down the multiplier ( — I)**/! — 
as was done in the scheme on page 215, but simply apply the rule stated 
on page 216. We shall now compute all the roots of an equation by 
GraefiEe’s method. 

Example 1. Find all the roots of the equation 

1.23a:® — 2.52a:^ — 16.1a:® -f 17.3x^ -f 29.4a: — 1 .34 « 0. 

Solution. The preliminary work of separating the roots is given on the 
following page and should be self-explanatory in view of what has been said 
above. When doubled products are too small to be written down, a star (♦) 
is written instead. 

It is evident that further squaring will simply give the squares of the 
coefficients in the last line of the table, and we therefore stop with the 
32d powers of the roots. Then by (79. 1) we have the following five 
simple equations : 

(7.541 X 102)a:i®" — 2.346 X 10"=^ — 0, 

(— 2.346 X 1022)a:2®2 + 3.95 X 10"' == 0, 

(3.95 X 10*0^3®'' — 8.744 X 10^® = 0, 

(— 8.744 X 10*«)X4®'' -f 2.148 X 10*' — 0, 

(2.148 X 10*^)a:.»^ — 1.175 X 10* —0. 



A*T. 79] ROOTS REAL AND UNEQUAL 



32nd p. 7.54M0* -2.346-1022 4- 3.95-1027 - 8.744-10^« + 2.148-10^7 





220 


GRAEFFE’S ROOT-SQUARING METHOD 


[Chap. X 


Solving these by logarithms, we have 


log a-, = 


20 -j- log 2.346 — log 1 
32 


= 0.60915. 


a:, = 4.066. 


In a similar manner we find 


Xo = 2.991, 2:3 = 1.959, 2:4 = 1.0285, 2:3 = 0.04447. 

The signs of these roots are yet to be determined. To do this we first 
apply Descartes’s rule of signs and find that there can not be more than 
three positive roots nor more than two negative roots. Then we substitute 
in the given ecpiation the approximate values ± 4 , ± 3 , =iz 2 , ± 1 , 
zh 0.04 and see whether the positive or negative value comes nearer to 
satisfying tlie equation. In this manner we find that the roots are 


T, = 4.066, 

2 :. = — 2.991, 
2:3 = 1.959, 

2:4 = — 1.0285, 
X, = 0.0145. 


The sum of these roots is 2.050, whereas i1 should be 2.52/1.23 = 2.049. 
The agreement is therefore as close as could be (‘xpected. 

80. A Check on the Coefficients in the Root-Squared Equation. All 

roots found by Graeffe's nndhod should be carefully checked by some 
means or other. The coefiici(*nts in the root-squared equations can be 
checked by a process due to H. Rainbow.* The root-squared equation 
(78.2) can b(' wriTieri in the form 

( 80 . 1 ) (—l)nf(x)fi—x) =F(X=) ==Aoixr)- + 

-f- .42(2:“')”'““ -f- ■ ■ ’ “h “h 

To derive Rainbow's check formula w(* put 2* = 1 and 2: = - - 1 in (78. 1) 
and (80. 1). Then we have 

' f, }i 

/( 1 ) = O'O “1" “|~ * ■ ■ “h ^ 'Ov 

k-U 

/(— 1 ) = an(— 1 ) ^ + (- - 1 )”-^ + 1)”-“^ + • • • + an.,{— 1 ) + an 

k=n 

-2 (— 

k-o ^ 

F(l) + + - ■ • + An^, + An = fA^. 

k^o 

* H. Rainbow, mathematician at the Research Laboratory of the Shell Oil Company, 
Houston, Texas. 
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On substituting these in ( 80 . 1 ), we get 

(80. 2) i = (- 1) '■ L i «,.] [ i (- 1 ) 

0 0 U 

which is Rainbow* a check formula. 

This formula is applied as follows: 

(a) Find the algebraic sum of the coefficients in any equation, either 
the given equation or an equation whose roots arc powers of the roots of 

the given equation. This gives the factor ^ (Z/, . 

0 

(b) Change the signs of the coefficients of the odd powers of x in the 
equation mentioned in (a) and then find the algebraic sum of all the coefB- 

cients. This gives the factor — l)"'^ak . 

0 

(c) Find the product of the sums found in (a) and (b) and then 
multiply this product by ( — The result should agree very closely 

n 

With th(; algebraic sum <^>f the eoelficients in the root-squared 

0 

equation next below the given equation. 

Example 1. Lot us apj)ly Lainbow^s check to the first root-squared 
equation in tli(‘ table on ])age 219. 

Here 

ri = o, i rzv == 27.97, i;(— 1 = — 1.09. 

0 0 

Hence 

(— 1)-^ (27.97) (— 1.09) = 30.4873. 

The sum of the coefficients in the root-squared equation is 

= 30.237. 

0 

The lack of agreement is due to the fact that the coefficients in the root- 
squared equation are rounded numbers multiplied by powers of 10. If 
the root-squaring process is carried through without rounding any numbers, 
we find = 30.4873, as the formula requin^s. 

Example 2. Applying Kainbow’s formula to the coefficients in the 4th- 
power equation of p. 219, we have 
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2 at 80,000, 2 (— 1 ) 1,696,000. 

Then 

(— [2(— — 136,000,000,000. 

Now finding the sum of the coefficients in the 8th-pawer equation, we get 
2-4*;=" 136,000,000,000. Here the agreement seems perfect, but such is not 
quite the case. The zeros occupy places of unknown digits which were 
cut off in rounding the squares and products. The only reliable significant 
figures in these sums came from the largest coefficients; that is, the 
coefficients containing the highest powers of 10. 

Although the Rainbow formula cannot give an accurate check in a 
numerical example, because the coefficients in high-powered equations are 
so large that they must be expressed by a few digits multiplied by powers 
of 10, it will nevertheless detect any large error in the process of squaring 
the roots. 

81, Case II. Complex Roots. When some of the roots of an algebraic 
equation are complex, the equation can not be expressed as a product of 
linear factors with real coefficients. Such an equation can, however, always 
be expressed as a product of real licear and real quadratic factors, each 
quadratic factor corresponding to a pair of complex roots. The root- 
squaring process can therefore never break up such an equation into linear 
fragments as in the case when all the roots are real and unequal. 

When an equation has complex roots, the root-squaring process always 
breaks it up into linear and quadratic fragments. The real roots, if any, 
are found from the linear fragments as in Case I, while the complex roots 
are found from the quadratic fragments. 

In transforming an equation by the root-squaring process the presence 
of complex roots is revealed in two ways: (1) the doubled products do 
not all disappear from the first row and (2) the signs of some of the 
coefficients fluctuate as the transformations continue. The reason for these 
peculiarities can be seen by considering a typical example. 

81a). Detection of Complex Roots. Let us consider an equation having 
two distinct real roots and two pairs of complex roots. Let these roots be 
Xi, rxe^\ and let the order of their magnitude be 

\xi\ > ri> \xz\ > r2. 

Then the equation having these roots is 

(1) {x — Xi) (x — {x — 

X {x — xs)(x — rze*^*) (x — — 0. 
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The equation whose roots are the mth powers of the roots of this equation 
is therefore 


(2) (y — ^1^) {y — {y — 

X {y — iCs”*) (y — {y — 0, 

where y — x”'. 

On performing the indicated multiplications in (2), then taking out the 
factors Xi^Ti^, and neglecting the ratios 


ri”* 

Xi”* ’ ’ Xi" 




" Xs" 


since each of these is negligible in comparison with unity, we finally get 

(3) y® — + 2xi"‘ri^ cos mSiy* — 

— 2xi^ri^"‘X3’*^r2^ cos mO-zy + Xi^ri^^X3’”r2^*" =» 0. 

The roots of the original equation have now been separated as much as 
they can ever be (since in deriving (3) we neglected such ratios as 
etc.), and the given equation has been broken up into the linear and 
quadratic fragments 

" y® — xi”^y^ = 0, 

— Xi’^y® -[“ 2x3 cos in$iy*‘ — Xi"*ri*’"y® = 0, 

— Xi’”ri*"*y® + Xi’^ri^’^Xs^y^ «• 0, 

^ Xi"*ri‘'”X3"*y^ — 2xi^ri^^xi^r2^ cos — 0, 


from which we can obtain the original roots with which we started. 

Suppose, now, that we apply the root-squaring process to (3) once more, 
as shown below: 



y® 

V 

y* 

y* 

mth p. 

1 

— Xi*" 

2 xi"‘r 3 "» cos 

__x,"»ri*"* 


1 

— Xi*" 

-I-4X1"*?-!"* cos mdi 

-l-4xi*"‘ri*’" cos* 17101 

— 2xi»"*ri*"* 

-|-2xrri»-‘x,"* 

— Xi*"Yi*’" 

-h4xi*"‘ri*"*Xi"* COS m0i 

— 4xi*’"ri*"*Xj"‘rj’" cos mOt 

H-2x,"*ri*’"x,-Yi*^ 

2mth p. 


-X,*" 

H-4xi*’Vi**" COB* mBi 
-2xi»"^i*’" 

— Xi*"*ri<’" 
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2/* 


2/° 

wth p. 


— 2xi’”ri2”‘X3”*r2"* cos m02 



— 4xi2”*ri^*"X3”*r2”* cos mdi 
-f-4xi^’"ri®™X3”‘r2*'" cos mOi 

- 4xi2"»ri^"»X32"r22*" cos^ rnSz 
-l-2xi2«ri<”*X3=^'~r2'"’" 

+ X i^"*x 3*”*r 2 ^”* 

2wth p. 


1 

— 4xi2*»ri*'”X3^”‘r2^”‘ cos* m 02 
-f 2xi*«r/’"X3*”»r2*"» 

-1- X i*”*r 1 *"*x a*"*r2^’" 


It is readily seen on dividing tlie doubled products in each column by 
the squared term at the top that all these products are negligible except 
two in the first row. Hence the sums of the several columns are as given 
above. This result shows why the doubled products in the first row do 
not all disappear when the complex roots are present. 

Furthermore, since 2 cos“ <f> — 1 = cos 2</>, w'e can write the coefficients of 
y* and y in the forms cos 2m6i and — cos 2m02, 

respectively. Hence the coefiicients in the last transformed equation are 
simply 

(5) 2mth p. 1 — cos 27n$i — 4- 

— 2xx^^r^^”^Xz^^r2^”" cos 2m62 + 

On comparing this last equation with the one for the mth powers of 
the roots we see at once that each application of the root-squaring process 
doubles the amplitudes of the complex roots. Hence the cosines of these 
amplitudes must frequcuitly change signs as the amplitudes are continually 
doubled. This explains the lluctuation in the signs of some of the coeffi- 
cients when complex roots are present. 

After the original equation has been broken up into linear and quadratic 
fragments by the root-squaring process, we can find the complex roots by 
solving the resulting quadratic equations for x/^ and then extracting the 
rwth root of the results by means of He 'Moivre’s theorem. Hut by pro- 
ceeding in this manner we would have ambiguities of sign in the computed 
roots, and such ambiguities are not easily removed. To obtain the complex 
roots without ambiguity as to signs we derive some further relations 
between roots and coefiicients. 

81b). Relations between the Coefficients of an Algebraic Equation and 
the Reciprocals of Its Roots. In the general equation 


OqX”' 4- aior""^ 4" + ’ ’ ' + tin.ix 4- — 0 
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let US put X = 1/y. The result, after clearing of fractions, is 

any^ + dn-iy^-'^ + an-2y^-^ + • • • + flay® + a2y^ + a^y + ao — 0. 

Hence from the well-known relations between roots and coefficients (p. 216) 
we ha^e 

~~ = (2/1 + 2/2 + • • + yn), 

Un 

~ = y>y2 + y>y2 + ■ • • + y^y-^ + • • • , 

W'n 


— = (— i)”yiy2- • yni 


or, since y = 1 /Xy 


f ^ 

Xi X2 Xn dn 


1 


( 6 ) 


1 ] L . . , ! ? 1- . . . J_ — - — _ 

X1X2 X1X2 X-^X^ Xfi^jXfi dn 


. 

0:1X22:3 ■ ■ ■ X „ a„ 


These relations between the coefficients and reciprocals of the roots will 
help us to avoid ambiguities of sign in the computation of complex roots. 

Exdmple 2. Find all the roots of the equation 


x'^ — ^x'^ — Zx^ -f 4a:2 — 5x + 6 . q. 

Solution. The preliminary work of separating the roots is shown on 
pages 226-227 and should be self-explanatory. 

It is evident from the last application of the root-squaring process that 
another application would effect no further separation of the roots. Hence 
we stop with the 256th powers of the roots. 

The given equation has now been broken up into three linear and two 
quadratic fragments. We first compute the real roots from the linear 
fragments. 

For the first real root we have by (79. 1) 


9.084 X 10"^ 




0.1222 c - 0 1255 
0.0025 H - 0.0082 
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from which we find by logarithms 


— 1.9626. 


The second real root is fojind from 

(— 9.084 • 10^^) • + 6.472 • 10^” — 0. 

Solving this by logarithms, we find 


X2 = 1.6379. 


The next two roots are complex, but the fifth, a real root, is found from 
the equation 

(3.879 • 10^’») - Xs"*'* — 9.852 • 10^“® = 0, 

from which 


Xa ^ 1.1080. 


To determine the signs of these roots we first apply Descartes’s rule of 
signs to the original equation and find that there can not be more than 
one negative root. The other two real roots must therefore be positive. 
On substituting in the original equation the rough values zh 2, we find 
that — 2 nearly satisfies the equation. Hence = — 1.9626. The three 
real roots are therefore 

X, 1.9625, X2 = 1.5379, x, 1.1080. 

The modulus of the first pair of complex roots is found from the 
quadratic equation 

(a) (6.472 ' 10 ^”)y 2 ^ (2.093 - 10'"^)y + 3.879 • 10""® =- 0, 

where y — a:*®®. Let ri denote this modulus. We find by means of a 
simple theorem conecting the coefficients of a quadratic equation with the 
modulus of its complex roots. 

Let the quadratic equation 

(b) 


x^ hx c — Oy 
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have the complex roots and Then 

{x — re*^) {x — rs”*^) 
s x* — r{e^^ + e**^) + r* 

EX* — (2r cos tf)x + r*. 

Hence c = r^, — 6 = 2r cos ^ ; that is, the absolute term in the quadratic 
(b) is equal to the square of the modulus of its complex roots. 

Let Ri denote the modulus of the complex roots of (a). Then on 
dividing the equation through by 6.472 X 10^** and applying the theorem 
just stated, we get 

^ 3.879 X 10^^ 

" 6.472 


Since, however, Ri = ri*®®, we have 


3.879 X 10"^ 

^ 6.472 

Solving this by logarithms, we find 

ri = 1.2909. 

The modulus of the second pair of complex roots is found in like manner 
from the quadratic 

(-- 9.852 X 10^*'°)^"'+ (0.163 X 10^®®)y — 1.618 X 10^®® — 0, 


(c) or 


0.1G3 X 10® 1.618 X 10" 

9.852 9.852 ~ ’ 


Denoting this modulus by rs and that of (c) by R., we have 


= 


1.618 X 10" 


1.618 X 10" 
9.852 


from which 


r2 = 1.0618. 


Now let the two pairs of complex roots be denoted by 

tXi + iVi, — ivx and U 2 + ivz, Uz — ivzy 

respectively. Then since the sum of the roots of the given equation is 0, 
we have 

Xi -f- X 2 “1~ ^Ui Xs -|“ 2 i^2 0, 


u^-\-Uz 0.3417. 
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We nezt apply the theorem connecting the sum of the reciprocals of 
the roots with the coefficients of the given equation, namely 

— + — H 1 h — H 1 ^ =“ . 

Xi X 2 tVy Uy tVy U 2 + 1^2 ^^2 ^^2 6 

Rationalizing the denominators of the complex terms and putting Uy^ -f“ 

— Ty^, “ ^ 2 ^ we get 

1 1 , 2^1 *1 2^2 _ 5 

Xy ‘ X 2 ' x-. r2* 6 * 

Now substituting in this equation the numerical values 

— 0.508386, 

Xy 

— -= 0.6502374, — — 0.902527, i — 0.60010, — 0.92875 

Xt ’ X, n* rj* 

and dividing through by 2, we obtain 

(e) O.eOOlUy + 0.92875^2 0.10552. 

Solving (d) and (e) simultaneously, we find 

Uy 0.6445, U2 — 0.3028. 

Vy and V 2 are found from the formulas v, = = V — ^i) 

and V 2 — V^ 2 * — ” V(^ 2 +U 2 )(r 2 — Uz) to be 

Vi — 1.1185, V2 — 1,018. 

Hence the two pairs of complex roots are 

— 0.6445 ±: l.llSt and 0.3028 di l.Q18t. 

We have thus obtained the complex roots without any ambiguity of signs. 
The computed roots in this example can be checked by substituting the 
values of the real roots and moduli in th^ known relation 

XiXzVy^Xg^rz^ — 6 , 

or 

log(xia:2ri2a:5r2^) -= log 6. 

These logarithms are found to be 

0.77816 — 0.77815. 

The agreement is thus as close as could be expected. 
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Remark. If an equation contains more than two pairs of complex roots, 
the moduli of the roots can be found from the quadratic fragments as in 
the example above. Then the real parts Ui,U 2 , ■ can be found by 

making further use of the relations connecting the roots and the reciprocals 
of the roots with the coefficients of the original equation. 

In some equations of high degree it might be advantageous, after finding 
the real roots, to depress the original equation by taking out the real roots 
and leaving only the complex roots. This is conveniently done by synthetic 
division. The relations between the roots and coefficients of the depressed 
equation should then be used. 

82. Case III. Roots Real and Numerically Equal. If two roots of an 
equation are numerically equal, the root-squaring process can never break 
up the equation into linear fragments. One of the doubled products will 
always remain in the first row. This product will be just half the squared 
term above it, as can be seen by considering an equation of the third degree. 

Let the roots of 

(1) + (^ 2 ^ -f as 0 

be Xi, X 2 , Xa. Then the equation whose roots are the mth powers of those 
of (1) is 

(y — Xi^){y — X 2 *^){y — Xs”*) =0, where y — x"*, 
or 

y® — {xi^ + Xz^ + X3^^)y^ -f (Xi^Xz^ + Xi^x^^ X2”^Xji^)y — x^x^^x^ — 0, 

or 

( 2 ) + 

+ ^ ^ ^ — 0. 

Now let X 2 — Xa and let | Xi | > | X 2 | . Then for sufficiently large valueb' 
of m the ratio xj^/x^ is negligible in comparison with unity, and (2) 
reduces to 

(3) y® — Xi’^y* -f ^Xx^xJ^y — — 0. 

The roots of the given equation have now been separated as much as 
they can ever be, but we shall apply the root-squaring process to (3) to 
see what happens. Using only the coefficients, we have 
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mth p. 

1 

-Xl* 

2xi"»xj"* 

— Xi^Xa*"* 


1 

—I,*- 

-l-4xi*"*Xa**" 

— Xi^-'Xa^*" 




— 2xi*’"xj»'" 


2mth p. 

1 

— Xi*"* 

-f-2xi»"xa*"» 

~Xi*"*X2^*" 


It will be noticed that the first doubled product is negligible in com- 
parison with the squared term above it, whereas the second is of the same 
order of magnitude as the squared term above and just half as large. 
Furthermore, in the equation for the 2mth powers of the roots all the coeflB- 
cients except one are the squares of those in the preceding equation. This 
remaining one is only half the square of the corresponding coefficient in the 
preceding equation. These peculiarities enable us to detect equal real roots 
immediately. We shall now show how to compute such roots. 

Example S. Solve the equation 


Solution, 


5z" + 2x2 — 15x — 6 0. 


Given equa. 

5 

2 

-15 

-6 


25 

-4 

— 150 n 

225 

424 c 

-36 

2d p. 

25 

-1.6410* 

42 49 10* 

-36 


6 25 10* 

-2.3716 10* 
-hi 2450 n 

46.2001-10* 

- 1 . 1008 c 

-1. 296-10* 

4th p. 

6.2510* 

-1.1266- 10* 

45 0993 10* 

-1.296-10* 


3.9062 10» 

-1. 269-10* 
4-0.637 n 

42 600 10® 
-0.029 c 

-1.680 10® 

8th p. 

3.906 10» 

-0.632 10* 

42.571-10® 

-1. 680-10® 


1.526 10“ 

-3.994-10“ 

+2.008 

46.610-10“ 

• 

-2 822-10“ 

16th p. 

1.526 10“ 

-1.986-10“ 

6.610 10“ 

-2.822-10“ 


The given equation has now been broken up into the simple frag- 
ment (6.610 • 10^®) Xg'* — 2.822 • 10^* — 0 and the quadratic fragment 
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1.526 • — 1.986 • 6.610 10^® = 0. Solving the simple 

fragment by logarithms, we find 


== 0.3999. 


To find the roots of the quadratic fragment we write the equation in 
the form 




1.986 X 10^ 
1.526 




6.61 X 10" 


1.526 


- 0 . 


Since the roots are known to be equal and since their product is equal to 
the absolute term of the quadratic, we ha^ve 


Solving by logarithms, we get 


6.61 X 10" 
1.526 


= 1.732. 


We check this result by putting the sum of the roots equal to the coeffi- 
cient of Xi^^ with its sign changed. Since the roots are equal, we have 

1.986 X 10* 

^ 1.526 ^ 

from which 

X, = 1.731. 


We shall next determine the signs of these roots. By Descartes’s rule 
there can not be more than one positive root nor more than two negative 
roots. Hence we try ±: 0,4 and find that — 0.4 satisfies the given equation. 
The other two roots are therefore zt 1.732. 


82a. Brodetsky and Smeal’s Improvement of Graeffe’s Method. The 

Graeffe method as ex})lained and illustrated up to this point is sufficient 
for finding the real roots and one or two pairs of complex roots of an 
algebraic equation. When an equation has three pairs of complex roots, 
they can be found without much difficulty by making further use of the 
relations between roots and coefficients; but since one of the real parts 
(w’s) must be found from a quadratic equation, thus giving two values 
of u, the proper value must be determined by trial. When the given 
equation has four or more pairs of complex roots, the practical difficulties 
in finding them are almost insurmountable. 

Brodetsky and Smeal * avoided all these difficulties by moving the origin 

* “ On Graeffe’s Method for Complex Roots of Algebraic Equations/’ by S. Bro- 
detsky and G. Smeal, Proc. Carnb. Phil. Soc., Vol. 22 (1924), pp. 83-87. 
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of x a small distance c and then applying the root-squaring process to the 
transformed equation. Their procedure enables all roots to be found 
without any ambiguities and without much additional labor after the 
root? of the transformed equation have been separated. The Brodetsky 
and Smeal improvement enables any number of pairs of complex roots 
to be found with the same ease as one or two pairs. The introduction of 
the auxiliary variable c more than doubles the labor of separating the 
roots, but does not cause any other additional labor in the solution. We 
present the Brodetsky and Smeal method in slightly modified form and 
apply it to two examples. 

Consider the general equation 

(1 ) -f 4* • * 4* CLn-iX -|- a„ 0 

and put 

(2) x = x'-^€, 

where < denotes a small variable whose squares and higher powers are 
negligible. On substituting (2) into (1), we have 

{x^ + c)^ + ai(x' + ^ 2 ( 2 ^' 4 

( 3 ) 

4 ' * * + (3:' 4 " <) 4 = 0 . 

Expanding the binomial quantities by the binomial theorem to only two 
terms, thus neglecting all terms involving c^, etc., we get 

a:'" 4 4 4 — l)x'^~^€] 

+ a,[x'-^+{n — 2)x'-\]+‘ • -^ 0 , 
or 

(4) a:'"* 4 (^1 4 4 [^2 4 — l)c]x'”'^4* ■ -^O. 

The root-squaring process is now applied to the transformed equation 

(4) instead of the original equation (1). The root-squaring is carried 
out by applying the rules stated in Art. 78, neglecting all c^’s wherever 
they occur. The rules must be applied to the entire coefficients (including 
the £-terms) of the a-'-terms. In the root-squaring table the terms con- 
taining € will be in rows below the rows of terms not containing c. 

Before proceeding to work the illustrative examples, we digress to derive 
the necessary formulas for finding the roots from the linear and quadratic 
fragments. The fragments will contain c. When written as equations 
according to (79.1), the linear fragments will be of the form 

(5) {A^ 4 B,e)x'”^ 4 {A, 4 B 2 €) = 0, 

where m denotes the power to which the roots of (4) have been raised. 
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From (6) we have 


A 2 “I” ^2^ 

Ai + Bit 


A*(l+|2c) 

4x(l+ Jc) 




where has been neglected in the division to get the expression in 

brackets. On replacing xf by x — « from (2), we obtain 


{x — t)^ 


— x”^ — inx^~^t — 


A2 

Ai 


A2 / B2 Bi \ 

Ai\A2 Ai)" 


Since this is an identity in €, the coefficients of like powers of e in the 
two members of the identity are equal. Hence we have 



Dividing (7) by (6) and solving for x, we obtain 


( 8 ) 


X = 


— m 

B 2 Bi 

A 2 Ai 


The value of x should be found from both (6) and (8) as a check, the 
latter giving the correct sign oi x. If the two values do not agree closely, 
there is some error in the root-squaring computation. 

The quadratic fragments when equated to zero will be of the form 


( 9 ) 

or 

( 10 ) 
where 
(11) 


{Ai -|- Bit)y^ 4“ {^2 + B 2 t)y + (.^3 -f- J?3c) = 0, 




A 2 B2t 

-4 1 + Bit 


y + 


A3 But 

Ti + Bit~^^ 


y= (x — €)"»== (re-*^ — 


From (10) we have 


A,(l +^0 ^3(1 

+ ^-y + ^ 


■0, 


or 
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0 , 


where, in the division, we have neglected as before. 

The product of the roots of ( 12 ) equals the constant term. Hence we 
have 




j)m(^g-itf 




The product on the left becomes [r^ — when c* is neglected. 

Expanding this to two terms by the binomial theorem and replacing 
6 *^ + 6 '*^ by 2 cos^, we get 

(13) r*” — 2TOr*”'-‘tcose = 4^[l + (^ — ^)£]- 


Now equating coefficients of like powers of c in both sides of the equation, 
we obtain 


or 



(14) 

and 



— 2 mr^"»"^ cos B = 




from which 

. /Bs B,\ 

r cos 6 = — - — I 7 - I . 

2m \As Ai/ 

But r cos 0 = u, the real part of the complex root. Hence we have 


(15) 

Then 

(16) 


2m Vila Ai/ 


The real roots of an equation are to be found from formulas ( 6 ) and 
( 8 ), and the complex roots from (14), (15), and (16). 

Example 1. Find the roots of the equation 


+ ?^x^ — x^ — 2x^ — 2x — \=0. 


Solution, We first put x = x^ -\-€. Then the equation becomes 
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+ €)» + + €)* — + €)« — 2(a:' + €)" — 2(a;' + c) — 1 — 0. 

Expanding the binomials to two terms and rearranging the coefficients, 
we find 

x'^ + (3 + 5c)x'^ — (1 — — (2 + 3c)a:'=* — (2 + 4c)x' — (1 + 2e) = 0. 

The root-squaring of this equation is shown in full in the table on 
pages 238-239. 


The table shows that the roots are completely separated by the 6th 
squaring (64th power). The table also shows that there are three real 
roots and one pair of complex roots, the midterm of the quadratic frag- 
ment being in the column under 

Since the 6th is the last squaring to be made, the parts of the coefficients 
not containing c’s and the parts multiplied by c are placed in separate 
lines, the first line being designated A and the latter B. The quotients 

— are placed in a third line for use in the formulas for finding the roots. 

To find the first real root, we substitute into formula (6) the first two 
terms in line A and thereby obtain 


Hence 


a:,«^ = l.ir>28X 10®^ 

64 log 2-1 = 32 -flog 1.1528 = 32.06175 
log 2-1 = 0.50096 
Xj = it 3.1693. 


B B 

Now substituting the ratios — ^ and into formula (8), we get 

A2 Ai 




64 

20.194 — 0 


3.1693. 


This result agrees with that found above and also gives the sign of 
To find the second real root, we substitute into (6) the second and 
third terms of line A and thus have 


1.74874 X 10^® 1.74874 X 10* 

“ 1.1538 X 10’" 1.1528 , 

Then 

64 log X 2 = 4 -f log 1.74874 — log 1.1528 = 4.18098 


log X 2 = 0.06533 
iFg ■=» it 1.1623. 


and 
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2.472 c -lO* -20.2776« lO^ 34.336€ -lO* -2.88* 

0.0952* n 4.7056* e -16.528* n -3.36* 

-0.0024* n -1.888* c 
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Then from (8) we get 

X2 -* 


— 64 


-34.867 — 20.194 


= 1.1623, 


which shows that this root is positive. 

The third root is found from the last two terms of the lines Ay By 

and . We thus have 
A 




and 


2.10729 X 10"* 

64 log X5 ^ 14 — log 2.10729 =» — 14.32372, 


1 A 

log = — 0.22381 = 9.77619 — 10, 


From (8) we have 




0-3 = 


64 

zb 0.5973. 

— 64 

128 — 20.913 


0.5976. 


The complex roots are found from the third and fifth terms in rows 
A and . Substituting the appropriate quantities into (14), we have 




10729 X 10"* 


74874 X 10^"* 


2.10729 
\ 1.74874 X 


X 10^" 


logr2 = — (log2.10729 — 22 — log 1.74874) 

0.34248 = 9.65752 — 10 

r2 == 0.4545. 

Then from (15) and (16) we get 
0.4545 


u 


128 


(20.913 + 34.867) = — 0.1981 


t; V 0.4545 — 0.0392 = 0.6444. 

Hence the complex roots are 

— 0.1981 zb 0.6444t. 

The five roots of the given equation are therefore 

— 3.1693, —0.5976, 1.1623, and —0.1981 it 0.6444i. 
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The sum of these roots is — 3.0008 and their product is 1. The solu- 
tions found are therefore correct. 

Example 2. The following equation arose in the investigation of the 
stability of a certain type of airplane.* Its solution is required. 

+ 20.42:" + 151.32-« + 4902;'^' + 6872:^ + 7192"’ + 1502:2 + 1092: + 6.87 

= 0. 

Solution. Putting x = xf -\- € and substituting this into the given 
equation, we have 

{xf + «)« + 20.4(2:' + €)" + ! 51 .3(2:' 4- c)** + 490(x' + 0" + 687(2:' + 0* 

+ 719(2:' + €y + 150(2-' + €>2 + 109(2:' + c) 4- 6.87 =- 0. 

On expanding the liiiiomials to two terms and rearranging the coefficients, 
we get 

2/» -f (20.4 4- 8£)2-'" 4- (151.3 4- 142.8£)2-'« + (490 4- 907.802:'® 

+ (687 4- 2450c)r'" 4- (719 4- 2748£)2:'’ 4- (150 4- 2157c)2:'2 
+ (109 4- 300 c) 2-' 4- 6.87 + 1 09c = 0. 

The successive ste[)s in the root-s(jiiaring of this transformed equation are 
^hown in tin* table* on p ‘M2. To save sfiace, only the siu'cessive equations 
are shown, with the ex('(q)tion of the last squaring. The complete results 
of the fifth s(|uaring (32nd jiower) are shown to enable the reader to 
distinguish at a glance the linear and (]uailratic fragments. Under the 
middle term of each quadratic* fragment is written the abbreviation ‘M‘os.’’ 
The table shows that there are three pairs of complex roots and two real 
roots. 


The first real root is found by formulas (6) and (8) from the first 
two terms in lines A and - . We have 

= 3.2920 X lO"" 

32 logo-, = 28 + log 3.292 = 28.51746 
log a-, =0.89117 
X, = ± 7.783. 


Applied Aerodynamicn, by Leonard Bairstow. New York, 1920, p. 493. 
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Also, 




— 32 
4.1236 


= _ 7.760. 


Hence the required root is 


Xx- 7.78. 


The second real root is found from the last two terms in lines A and 
We have 




0.605 X 10"^ 


6.05 


1.8572 X 10®" 1.8572 X 10^“ 

32 log j:« = log 6.05 — 38 — log 1 .8572 =- — 37.4871 

log Xh 1.1715 = 8.8285 — 10 

0.06738. 


Also, 


We take 


Xh- 


32 


508.25 — 32.815 


-0.06731. 


x^ — — 0.0674. 


From the first quadratic fragment and formulas (14), (15), (16), 
we have 




0.8317 X 10"® 
3.2920”x 10 "® 


»*/8.317 X 10" 
\ 3.292 


log Tx^ == ^ (49 + log 8.317 — log 3.292 = 1.54383 


= 34.981 

34.981 


Ux 


64 


(14.377 — 4.1236) = — 5.604 


V34.981 —31.4048 = 1.891. 
Hence the first pair of complex roots is 

— 5.604 dz 1.891i. 

For the second pair of complex roots we have 




'—6.7553 X 10®® 


6 . 

\ — 0 . 


8317 X 10"® 


"/6.755 

\ 8 


53 X 10^' 


8.317 
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\ogr./= (11 + loKG.7r)53 — log8.317) =0.34093 

rj= = 3.19245 

2 1924 5 

u.. = ^ (33.871 — 14.377) = — 0.6678 

64 

r^. = V -M ^>^^^4 5 — 0.44596 = 1.322. 

The second pair of conip)le.\ roots is then 

— 0.6678 It 1.322t. 


For the third j)air of complex roots we have 


^ 3 ^ 


1.8572 X _ *2/ ' T8572 
\ — ‘6.757)3^X^10^ “ \ 6.7553 X 


log ra^ = — (log 1 .8572 — 24 — log 6.7553) = — 0.76752 = 9.23248 - 


10 


r,2==0.1708 

0 1 ^08 

«3 -J-'- (32.815 — 33.871) =0.002818 

64 


1^3 = VO.1768— (0.002818p = 0.413. 


The third pair of complex roots is thus 

0.002818 It 0.413i. 

The sum of the roots we have found is — 20.39 and their product 
is 6.872. 

The Brodetsky and Sm(‘al imdhod is elegant and jiowerful, and enables 
the roots of equations of any degree to be found unicjuely ; but it has the 
disadvantage of greatly increasing the labor of separating the roots, with 
a corresponding increase in tlie possibility of errors in the root-squaring 
operation. Errors are most lik(4y to oc(*ur in computing and recording 
the doubled products — by forg(*tting to multiply by 2, by recording the 
results w'ith the wrong sign, <'tc. In a long computation such errors can 
be f)reverited only by the utmost vigilance on the part of the comjiuter. 

For the reasons stated above, the l>rodetsky-Smf‘al method is not advised 
for solving equations having few^er than three* pairs of complex roots. 
When an equation of the* sixth or higher degree is to be solved, it is well 
to separate the roots first by the* ordinary me‘thod, not using the c’s. Then 
if it is seen that there are threa* or more pairs of (‘omplex roots, the given 
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equation should be transformed to and t’s and the root-squaring 
repeated. The first root-squaring can be used as a guide and partial 
check on the second. 


82b. Improving the Accuracy of the Roots. The ac(;uracy of the 
roots found by the Graeffe method can be improved to any desired extent 
by several methods, one of the best being the Newton -llaphson method. 
Although that method was ap})lied only to the (;omf)utation of real roots 
in Art. 66, it is equally applicable to the im])rovement of complex roots, 
as we shall now show. 

A function of a complex variable z can be represented about a point Zo 
in the complex plane by the Taylor series 


( 1 ) 


/(^) — / (^o) f ^o) “h ^ 2 ” ’ ' ’ 


n! 


{z — Zo)^ + - • 


If we put z — Zo = h or z=^Zo-\-h. where h is now complex, the series 

(1) becomes 

(2) f(Zo + A) = fiz„) + hfU.) + Y f"(z«) + • • • + + • • ■ . 


If Zo is an ap])roximate value of a root of the equation f{z) =0 and 
h is a correction su( h that f{zo~\-h)=0, then (2) becomes 

(3) f i^u) f" i^o) ’ ■ • = 0. 


Since the modulus of h is a.ssiimed to be small, we may neglect in (3) all 
ti‘rms higher than the first degree in li. Then we get 


(4) 






which IS the Newton-lla])hson formula. 
The improved value of z is then 


(5) 



Example. Approximate values of the complex roots of the equation 


/(r) = j-^_3a-^ + 8x2 — 5 =-0 
are 

Zq == 1.39 dt 2A7i. 
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Find more accurate values of these roots. 

Solution, Since the imaginary parts of complex roots are always 
numerically equal and of opposite sign, it sufKces to improve only the 
root with positive imaginary part. Hence we take 

20 = 1.39 + 2.471. 

Then since 

f'{x) *= 4iX^ — 9x^ + 16x, 

we have 

f(zo) — (1.39 + 2.471+ — 3(1.39 + 2.470" + 8(1 .39 + 2.47^" — 5 

f(Zo) — 4(1.39 + 2.470" — 9(1-39 + 2.470" + 16(1.39 + 2.470. 

The right-hand members of these equations can be evaluated by direct 
expansions by the binomial theorem, but they can be evaluated with less 
labor by changing the parenthetical terms to polar coordinate form and 
then using the relation 

(a + &{)" = r"(cos nS + tsin nO). 

Using the latter method, we have 

r== V (1.39)2 ^ (2;47)2 = 2.83425475 
2.47 

sin 0 = = 0,871481295 

r 

1 39 

cos e = = 0.490428745 

r 

^ = 60°37'52."44. 


Then we find 


/(2o) =0.1437 — 0.0010741 
f{z^) = — 31.261339 — 25.288849t 


0.1437 — 0.0610741 
31.26 + 25.29i 


0.0018 — 0.OO341. 


The corrected value of z is therefore 


z = 1.3918 + 2.4666i 
and the improved complex roots are 
2— 1.3918zt 2.4666t. 
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Carvallo * has extended Graeffe’s method to the solution of transcendental 
equations by expanding the equation into a Taylor series, neglecting the 
remainder term, and then treating the resulting polynomial as an algebraic 
equation. 

EXERCISES X 

Find to four significant figures all the roots of the following equations: 

1. + 7.182-^ + 19.412:" + 1.832; + 2 = 0. 

2 . 3.26a:« + 4.2x^ + 3.08x« — + 1.922; — 7.76 — 0. 

3. 2;« — 62;“ + 32r* + 62;® — 6x + 2 = 0. 

4. 2;’ + 32;^ + 6 = 0. 

5 . + 7.732;" + 12.842:* — 1.1112*" — 55.72** — 125.3x® 

— 1 57.9x2 — 112.32; — 56.3 = 0. 


^ Loc. cit., p. 24. 



CHAPTER XI 


THE NUMERICAL SOLUTION OF ORDINARY 
DIFFERENTIAL EQUATIONS 

I. EQUATIONS OF THE FIRST ORDER. 

83. Introduction. Certain types of diflFerential equations are dealt witli 
in textbooks on calculus and differential equations^ and methods are 
developed for solving equations of the types treated. Comparatively few 
differential equations, however, can be integrated in finite form. But just 
as there are methods for finding to any desired degree of accuracy the roots 
of any algebraic or transcendental equation having numerical coefficients, 
so likewise there are methods for finding to any desired degree of accuracy 
the numerical solution of any ordinary differential equation having 
numerical coefficients and given initial conditions. Starting with the 
initial values, the solutions are thence constructed by short steps ahead for 
equal intervals Ax = h of x, each step usually being checked by some 
method before proceeding to the next ctep. The most important of the 
several methods for solving differential equations numerically will be 
explained in the following pages. 

84. Euler’s Method and Its Modification. The oldest and simplest 
method, but also the crudest, was devised by Euler. A differential equation 
of the first order may be written in the symbolic form 

( 1 ) =/**■»> 


The integral of (1) gives y as a function of x, which may be written 
symbolically as 

(2) y = F{x). 


The graph of (2) is a curve in the xy-plane; and since a smooth curve 
is practically straight for a short distance from any point on it, we have 
the approximate relation (see Fig. 13). 


so that 


Ay Ax tan 6 


yi 




Ax. 


24 H 
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Then the values of y corresponding to X 2 { — h) , x^(=x 2 ’\-h), etc. 
are 



By taking h small enough and proceeding in this manner, we could tabulate 
the integral of (1) as a set of corresponding values of x and y. Such was 
the method of Euler, but it is either too slow (in case h is small) or too 

Y 



0 


Fig. 13 


inaccurate (in case h is not small) for practical use. Even if h is taken 
very small for all steps, it is evident from the figure and other con- 
siderations that the computed y’s will deviate farther and farther from the 
true y’s so long as the curvature of the graph does not change. These 
considerations have led to a modification of Euler’s method, as shown below. 

Starting with the initial value yo, an approximate value for is com- 


puted from the relation 



Then this approximate value of yi is substituted into the given equation 

(iy 

(1) to get an approximate value of at the end of the first interval, or 


250 


SOLUTION OF ORDINARY DIFFERENTIAL EQUATIONS [Chap. XI 





Then an improved value of Ay is found by multiplying h by the average 

dy 

(mean) of the values of at the ends of the interval Xq to Xx, or 


\ dx / 0 \ dx J \ 

2 


^ dx J 0 


That this value of Ay is more accurate than the value 

if we think of ^ as the rate of change of y with respeot to x. 
approximation for yi is now 


is evident 
The second 




^ dx J Q y dx J X 

h. 


This improved value of y/^^ is now substituted into the given equation 


(1) to get a second approximation for 



or 



( 2 ) 


I 


The third approximation for yi is then 



The process is repeated until no change is produced in the value of yi 
to the number of digits retained. 

The computation for the next interval Xx to X 2 (= Xx h) is carried 
out in exactly the same manner, by first finding an approximate value of 
Ay and then applying the averaging process until no improvement is 
made in yz. 

That this modification of the Euler method gives a great improvement 
in accuracy over the original method can be seen by a glance at Fig. 14. 
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In this figure the Ay computed by the Euler method is represented by KM. 
If PN is drawn parallel to the tangent at Q, the Ay computed by using the 
slope at Q is represented by KN. On the other hand, if we take the 
average of the slopes we get 

*=!['. (t) + 0 (^).] 

= ^{KM + KN) = i{KM + KM + MN) — KM + ^MN, 


which is very close to its true value KQ. The attainable accuracy in any 
case is limited by the length of the step h. 

Although the modified Euler method is slow and of limited accuracy, 
its simplicity and applicability make it a method of great value ; for it enables 
one to start the solution of problems where no other method will work. 

First approximations to y^^Vay' ' * ^tc. could be found by means of 
the formula 


yn^i — + 



as was done above ; but as soon as two consecutive values of y are known, 
the first approximations to succeeding y’s can be found more accurately 
from the formula 
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(3) ^n + i — yn 1 -j- ‘ 

To derive this formula, ltd the funetioii y he represented in the neigh- 
borhood of x^n Taylor’s series. Then 

(a) =/Un) + Yr(^«)+^r(j-«) 

(b) /(x„-/o =f(x„)-hr(x„) + jr(-rn)-^r(jrn) 

il 

Subtracting (b) from (a), we get 

(e) f{s„+h)-fij-„-h)=‘>hr{x„) + ^-‘^ru„) + ^^^f''{x„) + - . 

Tu terms of y, (a) and (c) may be written 

(^) yn^\ ^ Vn -| ■ 

(e) t/n.i = yn 1 + v/'/n + g y'"n + 

When h is small and only tlie first two terms in tlu' right-hand members 

of (d) and (e) are used, the rrumation errors an* ^ y'\ and y'*\j 

respectively, and tin* latter is much smaller than the former. Hence (e) 
gives a more accurate \alu(* of y„.i. 

The first approximations to // found from (3) an* to he correc'ted and 
improved by the av(*raging process described above. 

The priiK'ipal })art of the error in the final value of y can be found 
as follows : 

Since the iiicr(*ment in y for <*ach step is obtained from the formula 

A i I y'^^ y^ rx,\\ 

= -i -)• 

the right-hand member of which ha< tin* form of tin* first group of terms 
in Eul(*r’s (juadrature formula, tin* j)rincipal part of the error in Ay is 

- iron..)-r(^„)i=^--(^r(o 


by the theon*m of mean value, where :r„ < ^ < 
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As an example of the use of the modified Euler method, we compute a 
few values of y for the differential equation 

with the initial conditions Xo == 0, = 1- 

Substituting these values of x and y in the given equation, we have 


—X 

I J j *^0 

\dx / 0 


+ ^0 — 


Taking h = 0.05, we then have 


y. (*) = j/o + A = 1 + 0.05 = 1.05. 

= a:. + = 0.05 + 1.05 = 1.10. 


The second approximation to y^ is therefore 


yi^'-‘> =yo + 


The second approximation for 


/^\ /M'>' 

VriaV , 1+1-1 

_ 1 + _ _ 

roximation for then 


X 0.05 = 1.0525. 


(S): 


0.05 + 1.0525 = 1.1025. 


Then the third approximation to t/i is 


j/jW r= 1 + X 0.05 = 1.05256. 

<C 


Continuing the approximation, we have 


= 0.05 + 1.05256== 1.10256, 

= 1 + 1 . + 1-10256 ^ Q Qg _ 1 05256. 

Since this is the same as we can get no further change in y by con- 

tinuing the approximations. We therefore take 


„ = I.052C, (g)_ 


1.1026. 
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As a first approximation to yg we have, by (3), 


0.1 + 1.1103 =1.2103. 




Hence 

/^y‘> 

\ dx/ 2 

Then 


(y*)**' 

and 

/^Y») 

\dx /2 

Hence 

(y*)'*' 


.1 + 1.1104= 1.2104. 

, 0.05(1.1026 + 1.2104) 


= 1.1104, 


which is the same as We therefore take 

( 1 ). = 

Collecting our results in tabular form, we have the following table : 


X 

y 

dy/dx 

0 00 

1 0000 

1 0000 

0 05 

1 0526 

1 1026 

0 10 

1 1104 

1 2104 


The question now arises as to the accurac*y of the results found above. 
Fortunately, the exact analytical solution of the given equation, with the 
stated initial conditions, is easily found to be 

y = — X — 1 . 

For X = 0, 0.05, 0.10, the corresponding values of y are 1, 1.05254, and 
1.11034. The values in the table above can be improved only by taking a 
smaller value for h, 

85. Picard’s Method of Successive Approximations. From the equation 

we have 

dy=i{x,y)dx=(^ dx. 
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Integrating this between corresponding limits for x and y, we have 


from which 


i’j’' = = S' (*) 

y = yo+ ^J{x,y)dx — ya-S dx. 


Here the integral term in the right-hand member represents the increment 
in y produced by an increment x — Xq in x. 

Confining our attention for the moment to the first form in (1), namely. 


y = yo+ r f{x,y)dx, 

•y wt% 


we notice that the equation is complicated by the presence of y under the 
integral sign as well as outside it. An equation of this kind is called an 
integral eqiuition and can be solved by a process of successive approxima- 
tions, or iteration, if the indicated integrations can be performed in the 
successive steps. 

To solve the differential equation 

by Picarcrs method of successive approximations, we get a first approxima- 
tion for y by putting yo for y in the integrand of (1). Then 


= yo 


f f{x,y«)i 

^ OBn 


The integrand is now a function of x alone and the indicated integration 
can be performed, in theory at least. Having now a first approximation to y, 
we substitute it for y in the integrand of (1) and integrate again, thus 
obtaining a second approximation 


Wo 


The process is repeated in this way as many times as may be necessary or 
desirable, the rith apj)roximation being given by the equation 


<">=yo+ r j{x,y'-^-^'>^dx. , 

^ mo 


We now apply this method to the simple example 


with the initial conditions Xq z= 0, yo = 1. 
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To got a first approximation we substitiife y = 1 in the riglit-liand member 
of the given equation, thus obtaining 

P^or second and third a})proximationa we have 


?/'■" =1+ ^a;+^+ar=*+a-+l^(ia:=|j + y + x* + a:+l. 

We liave thus found y as a power series in x. I"or x — 0.1 we have 


0.0001 

24 


0.001 

3 


+ 0.01 + 0.1+1 =^1.1103. 


This value of y is correct to four decimal places, as shown on page 250. 
For a: = 0.2 the corresponding value of is 1.2427, whereas the true 

value is 1.2428. We could get a better value by continuing the approxima- 
tions to y^'^^ i tiut it IS belter to move up to the point x — 0.1 and 

start all over again. 

The graphs of y^^\ V “ shown in Fig. 15. It will 

be seen that the approximating curves apjiroach the curve y — F{x) more 
closely with each successive ajiproximation. 

Now taking x = 0.1 and y ~ 1.1103 as initial values, we have 

3 /'^) 1.1103 + i’’ {x -F 1.1103)ria: 

•X 0 1 

= Y + 1.1103X + 0.9913. 


Then for second and third approximations wv get 


y(2) 


= 1.1103 + 


iox 2 


+ 1.1103J: + 0.9 


943 ^ 


(lx 


= Y 4- 1,0. 2 3-- -f 0.9943X -I 1.0001. 


y<‘'> = 1.1103 + 


+ Y + 1 .0r)r)2x== + 0.9943X 4- 1 .000 1 ^ dx 


= 1- 0.351 7x" + 0.9972X* + l.OOOlx + 1.0000. 

24 


For X = 0.2 we get y — 1 2128, which is correct to four decimal places. 

We could now move up to the ])oint a: ~ 0.2 and start over again; but 
since this method is not much used in practice, we shall not continue the 
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Y 



computation by this method. 

The practical difficulties associated with the method as outlined above lie 
mostly in the difficult and sometimes impossible integrations which would 
often have to be performed many times over. For example, if we wished 
to solve the equation (7y/Jx ~ with the initial conditions 

Xo — 0, y^, ~ 1, we should have 


yd) 


1 


0 1 + J .lo \l+a: / 


0 ^ 

1 + 2 In (1 4- x) — X, 

1 + In (1 -I- x) 


y "’ = 1+1 V 

,/ o 1 


dx 


-f- In (1 -h 

as / \ 

1 4- 2In (1 +x) 
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and our troubles would continue to pile up as wo continued the approxima- 
tions. The difficulties would be far greater in other examples which might 
come up for solution. Fortunately, such difficulties, and indeed all direct 
integrations, can be avoided by the methods to be explained in the next 
two articles. 


86. Use of Approximating Polynomials. We avoid the difficulties just 

dy 

mentioned by replacing by a polynomial and then integrating this 

polynomial over any desired interval. The appropriate polynomial for 
this purpose is that given by Newton’s formula (IT), because in the 
numerical integration of differential equations we always start with given 
values (initial conditions) and construct the solution from that point 
onward. Hence the values of the function immediately behind us are 
always known, but the values ahead are unknown. The problem is always 
to find the next value ahead. 

dv 

Writing 1/ in place of and replacing y by y' in formula (II), p. 65, 
we have 

r / / . w(i^-|-l) , , , i/i(u -(- l)(?i -f 2) 

( 1 ) y — y n-{- WAiy n H n H ■■ “ “ ^ n 


2 

I ^ / 

"r 24 " 




= y'„ -f- A,v'nM H (“■ + + 2u) 




where 


T — Xn 

u = — ^ or X 


hu. 


Since the change in y for any interval is given by the formula 

wc can find by means of (1) the change in y over any interval where 
dy/dx JS continuous. We therefore have for any interval 

Ay= f*'” r y'n + ^>y'r,U + (u- + u) 

(u3 -I- 3u= + 2u) + (u* + Gu* + llu" + 6u)1 dx. 

6 J 
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Since x = Xn -j- hu, we have dx = hdu. Substituting this value for dx 
above and changing limits, we get 

— \_y'n + A.y'nU + ^ " (“■ + “) + - (w"* + 3u“ + 2u) 

+ — (W + C>u^ -r 1 1«- -|- (itt) du, 
or 

tn\ A I r / r A / I w’ , m''\ I .\ 

( 2 ) Ay = h^ij„v + A,y n Y + ■ y-l -3 + Y ) + 4 + + w- j 




Let us now compute the value of Ay for the intervals Xn^i — Xn, Xn — Xn-i, 
Xn-^ — Xn -23 etc. by substituting in (2) the j)roper limits for u. For the 
interval Xn^i — Xn the limits for u are 

Uk*l — {Xnfi Xn)/h — h/h — 1 , Uk ~ {Xn Xn) /h — 0 . 

On substituting these in (2) and simplifying, we get 


Ay = I = h 


[j/'~ + \ 4- ^ A^y'n + I A.y'n + A,y'„ ] . 


For the interval Xn — Xn i the limits for u are 


^n — Xn ,, Xn ,—Xn —h 

Uk.i = 1 — 0, % = = — — = — 1 ; 


and therefore 


— J'i.i — [^.V'n 2 12 24 ” 720 J * 

Proceeding in the same way for the other intervals, we get formulas 
for the changes in y in those intervals. The results for the several 

intervals are: 

(86. 1) = h |^y'„ -f I A.y'n +^A.y'„ + •? A^y'™ + ^ A,y'n ] , 

(86. 2) = h [y'» A.y'„ A.y'n A3y'„ - y^- A.y'„ ] , 

(86. 3) 1^1 = h j|y'„ — A,y'„ -f- A^y'n + A.,y'„ ,+ ^*y'” J > 

(86. 4) — h l^y'n — 2 12 8 J ’ 

(86. 5) 1^1 = h [y'„ - 1 A,y'„ + If A.3/'» - ~ A^y'n + A,y'„ ] . 
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In the application of formulas (86.1) and (86.2) the coefficients-^^ 

19 11 

and may ht' replaced by -- and — , respectively. 
i 20 " 3 38 


By adding (86.1) and (86.2) and then (86.2) and (86.3), we get 
the following additional fornlulas : 


( 86 . 6 ) 


(86. 7) 


=*[ 

2/„+^Ay„ + iA32/'„+f5 A^n] 

II 

y ’• “f“ Q {^.y'n + Ajy „ A,i/ „) Y^‘ Aiy 

It. 

|] y'n — A,/„ + 1 A,l/'„ — yU J . 


Beplacing the first and second differences in (86. 7) by their values in 
tenis of tlie y'’s, namely 


n — y n y n-\ ? ^>3/ n y n ^2/ n-i ”f“ 3/ "-2 > 


and sinipli fving. we may write (86. 7) in the e(pi ivalent form 
(86. 8) ^ 'J (,/„ -(- Ay',,., + y'„ ,.) - A.y'„ , 

wiiK'li w(‘ recognize at once as Simpson’s Rule with its remainder term. 

Instead of using (86, 1 ) for ('omputing the first approximation to Ay 
in the next step ahead and cheeking it by (86.2), w^e may use explicit 
formulas for the afiproximate and corrected values of the next y ahead. 
Since 

yn, 

we may replai-e by this value in (86,1) and obtain the formula 

( 86 . 9 ) — yn ^^\y\ ^ ^\y\ + ^^y'n + ^ ^ 

a bar being placed over to indicate that it is a first apjiroximation 
obtained by extrapolation. Then when (86.2) is ajiplied to the new 
interval, the n and ri — 1 in that formula become n 1 and n, respectively. 
Hence the corrected y at the forward end of the new interval is given by 
the formula 

(86. 10) 

~ yn “f" n+l *2 Y 2 n+1 ^4^n+i ] > 
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where ^n+i is the value of rf obtained from the given equation when the y 
therein is replaced by the i/n+i found from (86.9). 

In like manner, when (86.6) and (86.8) are replaced by explicit 
formulas for y, we get 

(86. 11) ^n+l = yn-\ + \j/ n + ^ (^ 2 ]/ n + 

(86. 12) ^n+i = yni + - iy\*i + ^y'n + yVi) — ^ A4 ^„+i, 

respectively, the y'n^i being found from the given equation as above. 

Now a word as to the use of the foregoing formulas. Formulas (86. 1), 
(86.6), (86.9), and (86.11) are formulas for integrating ahead by extra- 
polation. They are used to start a new line in the computation and are 
used only once in each step-interval. 

Formulas (86.2), (86.7), (86.8), (86.10), and (86.12) are used for 
checking and correcting the extrapolated values found by the formulas 
for integrating ahead. They may be used more than once in any step- 
interval. 

The intervals covered by these formulas are shown graphically in Figure 
16. 


t 1 -4 " I M f ■ — 

n-4 n-3 n-2 n-l n Ji+I 

Fig. 1() 

Formulas (86. 1) and (86. 2) are the main tools which we shall use in 
the numerical integration of ordinary differential equations. It is needless 
to say that all the foregoing formulas apply equally well when the variables 
are any quantities whatever — time and acceleration, time and velocity, etc. 
Their use will be illustrated by several examples in the pages ahead. 

Historical Note. The method of replacing the derivative of a function 
by a polynomial and integrating that polynomial over an interval was used 
by J. C. Adams as early as 1855.* Adams diunved formulas (86.1) and 
(86.2), but he did not use (86.1). He used (86.2) in the manner 
indicated on page 251 and then applied a correction formula. 


* An Attempt to Teat the Theories of Capillary Affrartion, by F. Bashfortli and 
J. C. Adams, Cambridge University Press, 1883. See the Introduction and Chapter 


III. 
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Example. We return once more to the differential equation 


dx 


= x + y. 


In Art. 84 we computed the entries in the following table, except that 
now we have added on the columns of differences. 


X 

y 

y’ 

All/' 


0 00 

1 0000 

1 0000 



0 05 

1 0526 

1 1026 

-hO 1026 


0 10 

1 1104 

1.2104 

-fO 1078 

-1-52 


Before proceeding further with the computation we had better check 
the values already found. If Xn denotes the third value of x in the table, 
then the second and first values will be Xn-\ and ‘Xn- 2 , respectively. (See 
Fig. 16.) To compute the increment in y for the first interval and thereby 
find y^ we apply formula (86. 3), since it covers the interval Xn-^ — Xn- 2 - 
We therefore have 

Ay = 0.05 [^1.2104 — I (0.1078) (0.0052)^ =0.05254. 

yi = 3/o + Ay — 1.0525. 

For the second interval we apply (86.2). Then 

Ay = 0.05 [ 1 . 2104 — I (0.1078) — ~ (0.0052)^ =0.05780. 

The corrected values of y are therefore yi = 1.0525, 

= 1.0525 + 0.0578 = 1.1103. 


We now make a new table containing the corrected values for y, y\ and 
the first and second differences of y'. We also insert in this table a column 
for Ay as a matter of convenience. 


X 

y 

Ay 

! 

All/' 

A*!/' 

AsJ/' 

0 00 

1 

000 


1 

000 




0 05 

1 

0525 

-hO 0525 

1 

1025 

40 1025 



0 10 

1 

1103 

4-0 0578 

1 

2103 

40 1078 

453 


0 15 

1 

1736 

40 0633 

1 

3236 

40 1133 

455 

42 

0 20 

1 

2427 

40 0691 

1 

4427 

40 1191 

456 

41 


The computation is continued by adding a new line to tho above table^ 
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the line for x = 0.15. The first step is to compute a new Ai/ by means of 
formula (86. 1), using the data of the third line: 

Ay = 0.05 [^1.2103 + 1 (0.1078) (0.0053)^ =0.0633. 

yjO) = 1.1103 + 0.0633 = 1.1736. 

Then 

(/) 30 ) = 0.15 + 1.1736 = 1.3236. 

The next step is to enter these values of y and y' in the fourth line of the 
table and then compute the differences of y\ as shown in the table. The 
entries in this line must now^ be checked and improved upon if possible 
by means of formula (86. 2). Thus^ 

Ay = 0.05 1^1.3236 — I (0.1133)—^ (0.0055) J =0.0633. 

Since this is the same value for y as previously found, there is no possibility 
of improving upon the results in the fourth line and we therefore take them 
to be correct to four decimal places. 

The fifth line in the table is computed in exactly the same way and is 
found to be correct at tlie first trial. 

The fact that the correct values of y were found at the first trial in 
lines four and five suggests that it may be expedient to double the interval 
of integration, in order to progress more rapidly. We therefore take 
h =0.10 and make a new table wnth differences to correspond to the longer 
interval. 


X 

y 

Ay 

1 

! y' 


A2y' 



0 0 

1 0000 


1 0000 





0 1 

1 1103 

+0 1103 

1 2103 

-hO 2103 




0 2 

1 2427 

0 1324 

1 4427 

-hO 2324 

-f 221 



0 3 

1 3995 

0 1568 

1 6995 

-j-0 2568 

+ 244 

+23 


0 3 

1 3996 

0 1569 

1 6996 

+0 2569 

+245 

+24 


0 4 

1 5835 

0 1839 

1 9835 

-fO 2839 

+270 

+25 

1 

0 5 

1 7973 

0 2138 

2 2973 

+0 3138 

299 

+29 

4 

0 6 

2 0441 

0 2468 

2 6441 

-fO 3468 

330 

+31 

2 

0 7 

2 3274 

0 2833 

3 0274 

-f 0 3833 

365 

+35 

4 

0 8 

2 6510 

0 3236 

3 4510 

0 4236 

403 

38 

3 

0 9 

3 0191 

0 3681 

3 9191 

0 4681 

445 

42 

4 

1 0 

3 4364 

0 4173 

4 4364 

0 5173 

492 

47 

5 

1 0 

3,4365 

0 4174 

4 4365 

0 5174 

493 

48 

6 


To start the line for x = 0.3, we first compute Ay by means of (86. 1), 



204 


SOLU TION OF OFDINAKV DIFFKF FNTIAL EQUATIONS [Chap. XI 


using the data in tlie line for x = 0.2. We have 

Ay = 0.1 f 1.4427 + 0.11(52 + 0.0092] = 0.1568. 

Hence ^ = 1 .2427 + 0.1568 = 1.3995, and (y')o^V =1-6995. We now 

enter these values in the table and compute the differences for that line. 
Checking these values by means of (86. 2), we get 


Ay == 0.1 ( 1.6995 — 0.1284 — 0.0020 — 0.0001 ) = 0.1569. 

Since this value of Ay is different from that previously found, we repeat 
the line for x = 0.3 and write this value of Ay in the new line. The second 
approximations for yo 3 and (y')o 3 are then 

yiV=- 1.2427 + 0.1569 = 1.3996, 

(y')o^V= 1.6996. 

Entering these values in the new line, comj)uting the corresponding dif- 
ferences, and then applying formula (86. 2) to the data of this line, we 
have 

Ay = 0.1(1.6996 — 0.1284 — 0.0020 — 0.0002) = 0.1569. 

Since this is the same value for Ay as previously found, we consider the 
results in this second line for t = 0 3 to be correct. 

The computations are continued up to ir = l, as showui in the table. 
It so happens that formula (86. 1) gives the correct result for every line 
except the last. Fourth differences were used in formula (86. 1), but 
not in (86. 2). 

Since the exact solution of the differential equation dy/dz = x -\- y, with 
the initial conditions Xq = 0, yo = 1, is 


y = 2e^ — X — 1 , 

we can compute the exact value of y corresfionding to any value of x. The 
following table gives the correct values of y for values of x differing by 
one tenth. 


X 

y 

X 

y 

0 

1 

0 6 

2 0442 

0 1 

1 1103 

0 7 

2 3275 

0 2 

1 2428 

0 8 

2 6511 

0 3 

1 3997 

0 9 

3.0192 

0 4 

1 5836 

1 0 

3.4366 

0 5 

1 7974 
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It will be noticed that the values found by numerical integration are 
in error by one unit in the last decimal place, beginning with the value for 
X = 0.2. The truth is that the source of these errors is in the value 1.2427, 
which is in error by one unit in the last figure. This error was simply 
carried on by addition throughout the table. To avoid such errors it is 
necessary to have the first two or three lines in the table correct. 

Note. There is another method for starting a new line in the table 
without the use of formula (86. 1 ) . It consists in assuming that the highest 
difference in the next line will be the same as in the line just finished, and 
then working backwards by adding the new differences to the values in 
the previous line. For example, suppose we take the line for x = 0.8 and 
try to find the next line. We have 


X 

y 

Ay 

?/' 

Ai!/' 

A 2 ?/' 

Aa2/' 

0 8 

2 6510 

0 3236 

3 4510 

0 4236 

403 

38 

0 9 

3 0191 

0 3681 

(3 9187) 

(0-4677) 

(441) 

(38) 

0 9 

3 0191 

0 3681 

3 9191 

0 4681 

445 

42 


The first step m this procedure was to assume that the third difference 
in the line for x = 0.9 was 0.0038, the same value as given in the line above. 
Then we added this 0.0038 to the second difference 0.0403 in the line above. 
This gave us a second difference for the new line. We added this 0.0441 
to the first difference iii the line above and obtained a new first difference 

O. 4677. This w^as then added to the previous y' to get the value 3.9187 for 
y' in the new line. 

The next step is to apply formula (86. 2) to this new line, using the 
quantities enclosed in parentheses (these quantities are enclosed in paren- 
theses to indicate that they are trial or assumed values). We thus get 

Ay = 0.1 (3.9187 -- 0.2338 — 0.0037 — 0.0002) = 0.3681. 

This value of Ay happens to be correct. We now add this to the previous 
y to get the new value of y and thus complete the line. But now th^ new 
y' must be computed by adding the value of x to this new y. We therefore 
repeat the line for 2 : = 0.9 and insert the correct values of all the quantities. 
In some instances it w’ould be nece.ssary to correct this second line. 

The method just outlined in this note is the one used by J. C. Adams and 

P. E. Moulton. It IS not as much trouble to apply as it may seem from the 
description above, but nevertheless it requires more labor than the method 
of integrating ahead by (86. 1) and will therefore not be used in this book. 

87. Methods of Starting the Solution. The determination of the first 
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few values of the function is the most important and usually the most 
laborious part in the numerical solution of a differential equation. It is 
the most important part because the first few values must be accurate to 
the, number of significant figures desired in the solution, and it is the most 
laborious because the first few values are sometimes not easily found to 
the desired accuracy. 

Formulas (86.1) and (86.2) involve the first four differences of the 
function y\ These differences can be constructed only when five consecu- 
tive values of y' are known. The first value of y' can be found from the 
given equation and the initial values of x and y; the remaining four can 
be found by one or more of several methods, the most important of which 
are the following: 


1. By Taylors Series. If y = f{x)y the familiar Taylor formula 

(1) f(x) =/(».) +/'(».)(» — I.) 

may be written in the less familiar form 

( 2 ) y = yo + y'o(a: — lo) — 3-0)- + (x — 

+ y^{x-x,y + - ■ ■ 

where Xq and yo denote the initial values of x and y. In finding y's by 
formula (2), it is desirable to keep \x — Xo | numerically small in order 
to have rapid convergence of the series and therefore high accuracy in 
the y^B. Hence in general we should work on both sides of the point x©; 
that is, we should compute y’s both to the right and to the left of the 
point X = Xo. Using the notation yi=:/(xo + /0, — f + 2h) , 

y.i=:/(xo — h), y _2 = /(xo — 2h), etc., we have from (2): 


( 4 ) = + 


( 6 ) y-i = yo — y'oh + 


y"oh,^ y"'oh’‘ . y"'oh* y''oA® 


3! 


4! 


5! 


t + ■ 


y''o(2hr _ y'"oi2hr , y'\(2hy y\(2hy 


(6) y.,z=y„-y'o(2ft) + ^ 

where h denotes the interval between the equidistant values of x. 


+ 
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If the successive derivatives of the given differential equation y' = f{x,y) 
are easily found, the five needed consecutive values of y' can be found from 
the initial conditions, the given equation, and the formulas (3) -(6) above. 

Example 1, Let the given differential equation be 

dy 

^ = y = * + y, with i# = 0, yo = 1. 

Here 

^ “f" y^^ — I I y* ^ y^^' — y^^ — y^^^ y^ — y*'' 

Hence 

y'o = a:o + t/o = l, y"o = 1 + t/o = 2, y'" ^ y" = 2, yv = y'" 2, y^ = 2. 

Now taking /i nz 0.1 and substituting in (3), (4), (5), (6), we get 

yi HZ 1.1103, y2 = 1.2428, y_i = 0.9097, y.^ = 0.8375. 

These values are all correct to four decimal places. The five desired con- 
secutive values of y' are now found from the given equation to be: 

y '.2 ziz 2:_2 + y. 2 = — 0.2 + 0.8375 zz: 0.6375 
y'_i zz: a:.i + y.^ izi — 0.1 + 0.9097 iz: 0.8097 
y'o = a:o + yo = 1 

y\ z=z X, -f y, HZ 0.1 + 1.1103 = 1.2103 
y\ =zx2 + y2 = 0.2 + 1.2428 = 1.4428. 


If the function y should be non-existent for values of x less than Xq, 
then we compute y’s only to the right of Xq by substituting in (2) the 
proper values of h. 


2 . By Milne's Formulas, It frequently happens that the higher deriva- 
tives of — f {x, y) cannot be found without excessive labor, or hardly 
at all. In such cases the above method cannot be used for starting the 
computation. If, however, the first derivative of y' — f{x, y) , or y", can 
be found without difficulty, the five starting values of y' can be found by 
certain formulas first used by W. E. Milne.* To derive these formulas 
we need two additional Taylor series similar to (3) and^ (5). 

Representing the function y', ^5 in the neighborhood of x — Xq by 

Taylor’s series, we have 


(7) 


y\ — y'o + y^'oh + 


y'"oh^ 


, y^ , . 

1 ji I r 


2 ' 3 ! ‘ 4 ! 

* American Mathematical Monthly, Vol. 48 (1941), p. 52. 
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(8) 


y — ?/ 0 y “4“ 


^./// 7 n 

y ohr 


iCyK I 

;V! 4! 


Adding (7) and (8) and then subtracting (8) from (7), we get 


(9) y\ + y'-i = + • ■ • 

r /V 

-ylV /, 3 

(10) y\ - y'., r= 2y\h + + ■ ■ ■ . 

Now solve (9) for y"'o, (10) for y"'o, and then substitute these values in 
(3) and (5). The results are 


(A) 

(B) 


yi — ^ 

^ ^ / 

y-1 — ya — j^{iy 


+ 16y'., + 7y'.) +^-^- - 

I + + y’\) + h 


180 

y\hl 

180 


These formulas give and t/_i as soon as and y\ are known. 

To find formulas giving t /2 and y. 2 , substitute in (4) and (0) the values 
of i/"'o and found from (9) and (10). The results are 


01 . 

(C) y, = yo + y ( 5y' _ 2y"„h = + y\h\ 

(D) y., = y„ _ ^ ( 5y'.. - y'„ - y \ ) - 2y"Ji = - ' y^,/^^ 

O 4.) 


These formulas will give* y-j and y 2 as soon as and y\ an* known. 

An additional formula is desirable for chneking y.. and 7/_^> when found 
from (C) and (D). Subtracting (B) from (A), we get 


or 


2/1 — 1/ . - ('/ M + 4y „ t- y , ) - - • , 


yi = 2/ 3 + “ {y'-i + 4y'„ -f y\ ) - - 


Since this formula holds for any interval of width 2h, we may wTite it as 
a general formula 

(E) yn^i = yn~i + (y n- I + 4y n + 2/ n+i) • 

The quantity^ (y'n-i + 4y'n -{- /n+i ) is evidently Simpson’s Buie and is 

an approximation to the d('finite integral which represents the 

increment in y for the two intervals from 2 :„— - h to Xn + h. 

In the application of formulas (A)-(E) tlie terms in y'^o arc omitted. 
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The formulas as used are thus accurate up to and including fourth 
differences. 

It is to be noted that the second derivative y" is to be evaluated only 
at the one point ( 2 ^ 0 , yo)- 

Concerning the use of the foregoing formulas, the first step is to 
compute trial values of y\ and y'_i from the relations 

(F) y\ = y'o + y'-i = y'o — W'o (Euler method) . 

Then substitute these in (A) and (B) to get first approximations to y^ 
and y_i. These approximate values of y^ and y_i, with the corresponding 
Xx and x_i, are then substituted into the given differential equation 
y' = f{x,y) to get improved values for y\ and y'_i, which in turn are 
substituted back into (A) and (B) to get better values for y^ and y_i. 
This iteration process is continued until no change is produced in y'l 
and To obtain high accuracy in y'_i and y'l the value of h must 

be small. 

Now having the three consecutive values y'_i, y'o, y\ to the desired 
degree of accuracy, we substitute them in (C) and (D) to get approximate 
values of yz and y^n by extrapolation. Then these, together with X 2 and x^ 2 y 
are substituted into the given equation to get approximate values of y\ 
and y'_ 2 . These latter are then substituted into formula (E) to get 
improved values of and y^o. If these agree with the previous values 
found by extrapolation, we take them as correct. Then these values when 
substituted into the g'ven equation will give correct values for y\ and y'_ 2 - 
We thus obtain tlie five needed consecutive values of y' to give us the 
various orders of differences to use in (86. 1). 

Note.. After having found y'-i, y'o. and y'l to the desired degree of 
accuracy, we could form first and second differences from these and then 
proceed with formulas (86.1) and (86.2). 

Example 2. To find five consecutive values of y' for starting the solu- 
tion of the equation 

y’ = yo = 1 ’ =^0 = 

we have 

— ( 5 !_±^) i^ y' + + ^yy’) 

^ ~~ + 

Hence 

y\ = 0, y"o = 1. 

Taking ^ =: 0.1, we have from formulas (F) 

y', = 0 + 0.1(1) =0.1, y'.i = 0 — 0.1= — 0.1. 
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Then by (A) and (B), 

= 1 + (— 0-1 + 0.7) + ^ = 1.0050, 

= 1 — (— 0.7 + 0.1) = 1.0050. 

Now substituting these y’s and the corresponding x’s into the given 
equation, we have 

___ (0.1) (1.005) 0.1005 

(0.1)’* + (1.005)== 0.01 + 1.010025 “ ’ 

y'-i = —0.09853. 

On substituting these into (A) and (B), we get 

yi<=) =1+1^ (_ 0.09853 + 0.68971) + 0.0025 = 1.00496, 

= 1.00496. 

Now substituting these into the given equation, we have 


(0.1) (1.00496) __ 0.100496 

“ (0.1)2'+ (1.00496)2 ^ '1.01994 
— 0.09853. 


0.09853, 


As these are the same values as previously found foi y\ and y'_i, we take 
them to be correct. 

Having “dug in,^^ as it were, about the point (xo.yo) and found three 
consecutive values of y' to the desiied degree of accuracy, we next find 
y _2 and y 2 by extrapolating bac’kward and forward by means of formulas 
(C) and (D). From (C) and (D) we have 


yj = 1 + ^ (0.59118) — 0.02 = 1.0194, 
o 

y.2 — 1 — (— 0.59118) — 0.02 = 1.0194. 

These ■values must now be checked by formula (E) after first finding 
y'j and y'.j from the giving equation.' Substituting in the given equation 
the value of X 2 {= 2 h = 0.2) and the value of yj found above, we have 

, 0.2(1.0194) _ 0.20388 _^,0QQ9 

(0.2)='+ (1.0194)= 1.07918 

Likewise, for x. 2 (- 2h 0.2) and the value of y., found above, 

we get 

, —0.2(1.0194) 

~ (—0.2)= + (1.0194) = 


0.18892. 
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Then from formula (E), 

y 2 = yo + 1 (y'o + 4y'i + y\) 

= 1 + ^^0 -1- 4 X 0.09853 + 0.18893) = 1.0194. 

For checking the backward value y .2 we write formula (E) in the trans- 
posed form 

J/n-i = yn^l {y 1 *-! “h n y n+i ) ■ 

Hence we have 

y-2 =yo — “ (/-2 + 4y'-i + y'o) 

= l — -~ (—0.18892 — 4 X 0.09853) = 1.0194. 

o 

Since these values are the same as those found by extrapolation, we con- 
sider them to be correct. 

Now having five correct consecutive values for y and y', we can form 
differences up to and including the fourth for these quantities and proceed 
with the numerical solution by means of formulas (86. 1) and (86.2). 

At this point it is instructive to compare these computed values of y and 

y' with their exacit values. The homogeneous equation y' =: — j -— ^ can 

readily be solved by the usual artifice of putting y = vx. The solution, 
with the given initial conditions, is found to be 

= y^ In y^. 

The Newton-Kaphson method, when applied to this equation, shows that 
yi should be corrected by the amount 0.000003 and y. by the amount 
0.00003. The values previously found are thus true to the number of 
significant figures retained in the computation. 

3. By the Runge-Kuita Method. The use of this method wnll be ex- 
plained in a subsequent article. 

4. By the Modified Euler Method. This method has been explained in 
Article 84. It can be used for starting the numerical solution of any 
ordinary differential equation and is used when the previously-explained 
methods cannot be used to advantage. 

After the five consecutive starting values have been found, the numerical 
solution of a differential equation is continued as far as desired by means 
of formulas (86. 1) and (86. 2). This part of the solution is mostly smooth 
sailing. If the differences higher than the second become negligible, it will 
be well to double the interval h. When this is done, a new table of differences 
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Then 


y'o go = 0.90 + 3.0191 = 3.9191. 


These are the same values as previously found before the interval was halved, 
and they indicate that no error was introduced in changing to the shorter 
interval. It is to be noted that the shorter interval reduces the fourth 
differences to insignificance. 


EXERCISES XI 


1 . Obtain by the modified Euler method five consecutive starting values 
for the numerical solution of 


dx 



with Xo = 20, yo = 5. Check the starting values by formulas (86. 2) to 
(86. 5) and then add two more lines to your table. 


2 . Obtain by Taylor’s series five consecutive starting values for the 
numerical solution of 


dy 

dx 


= 2x — y, 


with Xo 1, yo = 3. Check the values and then add three more lines to 
the table. 

Compare your results with those obtained from the exact analytical solu- 
tion y = 2a: + — 2. 

3 . Tabulate the numerical solution of 


dx 


= sin X -f- cos y 


from Xo = 30®, yo = 45® to a: = 60®. 


4 . Use the Taylor-series method to start the numerical solution of 


with aJo = 1, yo = 0. 


dx 


= x* -f y*. 


Then solve the equation analytically and compute accurate values of y 
for comparison with the computed starting values. 

6. Given the equation 
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with a:© = 1, ^0 = 1/4; find {d^y/dt")^ and then find five consecutive 
starting values by means of the Euler method and the Milne formulas. 

Note that a solution exists only in the regions where | x/2y | > 1. 

6. Integrate the equation of Ex. 2 by Picard^s method of successive 
approximations. 

II. EQUATIONS OF THE SECOND ORDER AND SYSTEMS OF 
SIMULTANEOUS EQUATIONS. 

89. Equations of the Second Order. Any differential equation of the 
second or higher order can be reduced to a system of first-order equations 
by the introduction of auxiliary variables. Thus, the second-order equation 

can be reduced to two first-order equations by putting y' = dy/dx. The 
resulting equations are 

In like manner, any equation higher than the second order or any system 
of equations of the second or higher order can be reduced to a system of 
equations of the first order. These first-order equations can then be solved 
by the methods already given, or soon to be given. 

Second-order differential equations can also be integrated numerically 
by the following formulas, adapted from (86.9) and (86.10): 


(1 ) = y'n + My"« + 1 + A + I A,y"» + 1 

for getting the trial value of 


(2) Vn*! — yn~{' ^ (^n+i ^ ^ 

for getting a first approximation to the new y^^i. 

( 3 ) = f(Xn^i) — Py'n.i — QVn^Xy 

the given equation, for getting the first approximation of 
y" at x^x. 
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(4) y'n^i — y'n “h ^(^^ti +1 

^4^ n+l)> 

for checking and correcting the trial y'n*i found from (1). 

Similar integration formulas can be obtained from (86. 11) and (86. 12). 
The overlined quantities y\^iy are so marked to indicate that 
they are the first approximations to y, y\ and at the point x = 


Example. When a pendulum swings in a resisitng medium, its equation 
of motion is of the form 


^ dO 
dt^ 


4" 6 sin ^ = 0, 


where a and b are constanis. Assuming a = 0.2, h = 10, start the solution 
of the above equation, taking as initial conditions ^ = 0.3 radian and 
dO/di — 0 when i — 0. 

Solution. The substitutions dS/dt — 6, d^6/dt^ =. dS/dt = 6 reduce the 
given equation t/O the two first-order equations 

dt ~ 


dB 

dt 


0.20 10 sin (9. 


Since the second equation involves 0 directly, it is necessary to compute 
this angle at every step tliroughout the conqiutation. Also, since 6 in this 
problem is always expressed in radians, it is praidically necessary to use a 
table of sines in which the argiiineiit is given directly in radians.* 

After the starting values have been found, the solution of this example 
will be continued by means of the following formulas, used in the order 
written : 

r .. .. 1 5 3 .. 1 

(1) ^0= ^ b di — (bn 4" ^ibn 4" 22 4“ y 4" ^*by^y 

for starting a new line. 

1 


( 2 ) 


-*=/. 


^n+l • 1 • 1 • 

^ (^n+1 ^ Ai^fi+i i\> ■ 


24 


■ Aa^n^ 




* The best table of this kind is Tables of Circular and Uyperholio Sines and Cosines 
for Radian A njurncnts. Nrw ^'nik, ID.'!!). 
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for finding the first approximation to 6 at time fn+i. 

(3) = — 0.2 — 1 0 sin 

for finding the first approximation to $ at time 

(4) ~ J 0 dt =: At (^n+i — Ai^^i Y 2 ^8?n+l 

1 iJ \ 

for checking and correcting the value of A$ found by (1). 

The $, 6, and ^ for the instant are underlined to indicate that 
they are the first approximations. 

If the first cycle of calculations for a step interval does not give results 
of the required accuracy, a new computation is made by applying (2), 
(3), and (4) in the order here given. 


The starting values for this problem can be found by any of the methods 
mentioned in Art. 87. We shall find them by the Taylor-series method. 
The Taylor series for B is 


( 5 ) 


0 — ^0 “h “h 


2 3! 


4! 5! 


6 ! 


+ • • •. 


From the given equation B = — 0.2^ — 10 sin 0 we get 
B = — 0.2^ — 10^ cos B 
B''' — — 0.2^ + 10 sin B — 6 cos B) 

B^ = 0.2B^^ + 10[((9" — B) cos B + SBBsin B] 

B^^ — — 0.20^ + 10 [(3^2^’- B^^) cosB— {B^ — ^B) sin ^ 
-j- 3{B^B cos B -]- B^ sin B B B sin B) ] . 


For B — 0.3 radian, ^ = 0 when t — 0 , the above equations give 
Bo = — 10 sin 0.3 = — 2.9552, 
k — — 0 , 2 k = 0.2 X 2.9552 = 0,59104, 

(9% — — 0.2^0 — 10^0 cos 0.3 — -- 0.1182 + 28.2321 = 28.1139, 

B\ = — 0.2(9^% — 10i9o cos 0.3 = — 5.6228 — 5.6464 = — 11.2692, 

zzi —0.2(9% — 10(9‘% cos 0.3 + 30(9"’ sin 0.3 = 2.254 — 268.582 + 77.425 
= — 188.903. 
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Substituting in (5) these values and the initial conditions, we get 


( 6 ) 


, = 0 . 3 -^ 
2 

188.90 ,, 

<• • 

720 


t^ + 


0-59104 .3 , 28-114 « 
6 "^24 


Differentiating (6) with respect to t, we have 


11.269 

(® 

120 


We are now ready to find starting values of 0, 6, and 9 for values of t 

near zero and at steps of ^ sec. Putting ^ 0, ^ (^) 

and (7) and then computing the corresponding values of $ from (1), we 
get the first five values of these quantities as given in the table on page 264. 

After forming the various orders of differences for these quantities, 
we are ready to extend the table by applying formulas (1), (2), (3), 
(4), etc. Two additional lines computed in this manner are given in the 
table. The actual computation of the line for ^ = 0.15 was as follows: 

Applying formula (2) tc the acceleration quantities in the line for 
t = 0.10, we have 

= ^ [— 2.758 + 0.066 + 0.029] = ~ 0.1332. 

This is the first entry in the new line for t = 0.15. Adding this ^9 to 
the previous value of 0, we get — 0.4211 for the new 0. Now compute 

the various orders of differences for the new 0. 

We next compute ^6 for this line by applying (4) to the 6 quantities. 
We thus have 


Atf = — [— 0.4211 + 0.0666 — 0.0007 — 0.0001] =r — 0.0178. 

20 

Adding this to the previous value of we have 

^0 18 — 0.2854 — 0.0178 — 0.2676. 

We next substitute in the given equation (1) the values of 0 and 9 for 
the new line, in order to get t)je acceleration when t — 0.15. We thus 
have 

e = — 0.2(— 0.4211) — 10 sin 0.2676 ~ — 2.560. 

Then we compute the several orders of differences for this acceleration. 
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The line for ^ = 0.15 is now completely filled, but it must be checked. 
Hence we apply formula (3) to the acceleration data last filled in and have 

t— 2.rm — ().();)» — 0.005] = — 0.1332. 

Since this is the same value of as previously found, there is no possi- 
bility of improving any of the entries in the line for t = 0.15 and we 
therefore regard them as correct. 

Succeeding lines are added to the table in exactly the same manner as 
above described. 

In this example the time interval At must be taken short, because d, $y 
and 0 are all changing rapidly. To obtain results accurate to four 

significant figures At should l)e ke[>t at second. 

Space does not permit the higlier difTerences of 0 to be shown in the 
table, but these differences should always be computed as a check on the 
accuracy of the computed valu(‘s of 6 . 

Another cheek formula for s(‘C*ond-order differential equations is (90.2) 
of the next article. 

Let us check the value of ^020 hi the above table by formula (5). We 
have 

tfo 20 = 2(0.2676) 0.2854 + [— 2.560 -f- (0.061 )] = 0.2434, 

which is the value already found and checked by (4) and (3). 

90. Second-Order Equations with First Derivative Absent. When 

second-order differential eijuations do not contain (irst derivatives, their 
numerical solutions can Ik* found by a shorter method than that employed 
in the preceding article. In this case W(* rej)la(!e the second derivative by 
a polynomial and integrate twice to find the desired formulas for numerical 
integration. 

We consider first the single equation 

(1) g =/<*.»>. 

which we write in the form 

(2) y" = f(^,y)- 

To find a formula for int(*grating ahead by extrapolation we start with 
Newton’s formula 1 1, in which we replace by We thus have 
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u{u 4 - 1 ) 


(3) y" = A 

I + 1)(^ + + 3) 


-}" 1)(^ + 


^4y"n + 


where u = — 7 — - or x — Xn-\- hu. Integrating (3) with respect to x and 

ft 

remembering that dx = hdu, we have 

/ = ^ [«y"» 4- Y (y + t) ^ (t “0 

. 1 /u® I 3m* 11m® , „ jX . // 1 , r« 

We determine C\ from the condition that y' = y'n when x = Xn and 
therefore w = 0. On putting u — 0 and y' = y'n in (4), we find = y'n- 
Now replacing Ci by y'n in (4) and integrating again with respect 
to X, we get 

y = huy\ + A® [f y"„ + I A.y"„ + (g + ^) A.y"« 

1 / M® M* . M®\ „ 1 /m« 3m® 11m* s\ » // “1 I /I 

We find C2 by putting y — y^ when 1/ = 0 and thus find C2 — yn- Then 
we have 

( 5 ) y = y„ + huy'„ + ‘ y"« + y + (^ + ^) ^2y"« 

I / m“ M* M®\, // , 1 /m® I 3m® .11m* jX 

6 V-iO 4 3 / 24 \3d 10 " 12 ”1“ “ / ^*^ "J ' 

The values of y for x = j-„n and x = x„-i are found by putting m = 1 
and u-= — 1 in (5). We thus obtain 

(6) y„*i = yn + h/,, + h- Q- y"„ + | Aiy"« + ^ Ajy", 

+ ^A«y",] 

(7) y»-x = y„ - hy\ + /r g y"„ - \ A.y"™ A,y"„ _ ^ A^y". 
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Adding (6) and (7), we get 


1 1 IQ 

+ yn-i = + A^[y"n + ^ n + ^ A,y"n]. 


12 


240 


19 11 

Now replacing — by we finally obtain 

(8) = 2y„ — y„-i + A"[y", + ^ + A4y",) 

which is Stdrmer’s extrapolation formula for integrating ahead.* 

To derive a formula for checking and correcting yn+i, we start with 
Stirling’s interpolation formula with y replaced by y", namely, 

W r=r . + . ^ AW, + 

2/ ' 2J 

where u = — r — - and therefore dx = hdu. 
n 

Integrating (9) twice with respect to x and determining the constants 
of integration from the conditions y' = y'n and y — yn when w = 0, we get 


(10) y = yn + huy'n + h'^ y"„ + y Ay »-i + Ay „ ^ ^ 

/ AW, + AW I , / «* u*\ 1>... 

^\120 36/ 2 288/ ^ »-* J ^ 

Now putting u = 1 and u = — 1 successively in (10) and adding the 
resulting equations, we obtain 

y«*i = 2y„ — y„_ 1 + ^ iy"„ -f ~ A Wi — ^ AyVa ) • 

On changing to horizontal differences by means of the relation A^y* 
= ^yk^, we finally get 

(11) y„.i = 2y„ — y*_. + h^y"„ + ^ — ~ A,/'*.*). 


•The equivalent of formula (8) was first used by Carl Stdrmer in 1907. Archives 
des Sciences physiques et naturelles, Geneve, juillet-octobre 1907, p. 63 ff. 
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In the applications of (8) and (11) the terms and 

— neglected. Hence the working formulas are 

(90. 1 ) = 2y, —y^i + h^ [y"n + ^ ( ^2y"n + Aay", + A«y"* ) ] 

for finding the approximate value of y«+i and 

(90. 2) = 2y„ — y,-i + h’‘(y"„ + ^ Aj^'n+i) 

for checking and correcting the found from (90.1). 

Formulas (90. 1) and (90. 2) give a step-by-step solution of the equation 
d^V 

~ f(x,y) with given initial conditions. The first is a formula for 
dx 

integrating ahead and finding the approximate value of yn 4 i by extra- 
polation. The extrapolated value is checked and corrected by (90.2). The 
starting values of y and y" are to be found by the methods given in Art. 87. 

Example. Tabulate the solution of 

(l^y 

— sin y -f 1 = 0, or y" = sin y — 1, 
with the initial conditions y = 0.1132 and y' = 0 when x = 0. 


Solution. We find the first few values of y from its Taylor expansion 
about the point x = 0. Starting with the given equation y" sin y — 1, 
we have 


cos y 


dx 


— y cosy 


y^^ — y'2 sin y -f y" cos y 

y^ — y'" cos y — 3y'y" sin y — y'^ cos y. 


Substituting in the above equations the initial values y = 0.1132, y' = 0 
when X = 0, we get 


y"o = sin(0.1132) — 1 = 0.112958 — 1 = — 0.88704 
y"'o == 0 

y*% = — 0.88704 cos(0.1132) =z — 0.88704 X 0.99360 = — 0.88136 

y\ = 0 . 
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Substituting these values in the Taylor formula 


we get 

(a) 


I / , y 0 , . y 0 3 . y‘''o * , y''o , 

y = yu + y oX + ^ + — :r* + 


y — 0.1132 — 0.4435a:‘" — 0.03672a;\ 


By means of this equation (a) we compute the t/’s in the first five rows 
of the following table. Then we substitute these y^s in the given equation 
to find the corresponding values of y" in the seventh column of the table. 
The differences Aiy", Azy", Ajy" are then computed. 


From this jioint onward we continue the computation with h = 0.06 


by means of formulas (90.1) and (90.2)^ always applying (90.1) first 
and then checking and correcting the new row by (90. 2). Hence to get 
started on the sixth row we apply (90. 1) to the last row found by Taylor’s 
series and get 


= 2(0.1088) -0.1121 + ^ [_ 0.8914 + 4 (-0.0022)1 


12 


= 0.1033. 


Then we substitute this value of in the given equation and find 
y'\ = — 0.8969. The sixth row is completed by filling in the new 
differences. 

We now apply (90. 2) to the new sixth row as a check on its correctness. 


We have 

y, = 2(0.1088) —0.1121 + ^ [—0.8914 — ^ (0.0022) J =0.1033 


as before. Hence we consider the sixth line to be correct. The succeeding 
lines are computed in the same way. * 

The differences of the i/’s are not used in the computation, but they 
should be computed as a check on the accuracy of the work. Irregularities 
in the higher differences would indicate that a mistake had been made in 
the computation. 

Systems of two, three, or any number of simultaneous equations of the 
second order in which first derivatives are absent can be solved numerically 
by formulas similar to (90. 1) and (90. 2). Thus for a system of three 
equations 
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(90. 3) 


r d^x „ 4 , .V 

_ = x =Mx,y,z,t) 

- ^ = y" = Mx,y,z,t) 

^ = ^" = h(x,y,z, t), 


each equation is integrated separately by means of its own formula 
analogous to (90.1). Then the extrapolated values of x, y, z are sub- 
stituted into the right-hand members of (90. 3) to get y", z" at the 
new point ahead. Then new differences are computed, and formulas 
analogous to (90. 2) are applied to the new rows as checks. 

The necessary formulas for the three equations (90.3), for example, 
are 


( 90 . 4 ) 


" = 2Xn Xn-i + h^[x"n + 3^ ( 

- Vn^i — J/n-l “h n H" 3 ^ (^ 2 ^^ n H" “h 

^thU — 2 Zn ^n-i -f- n 3^ ( A2Z "I- AaZ^^n “f“ A^Z^^n)] 


for finding approximate values at the next point ahead, and 


( 00 . 5 ) 


" Xn*i = 2Xn Xn-i + h^(a\ + 3ijA2f"n4l ) 

^ J/n+l = ^Vn Vn-l + + i^A2^'n+ll 

Zn^l = 2Zn 2n-i + {z"n + 3 ^A 2 l"n^l ) 


for checking and correcting the new values given by (90.4). Here 

h ^n-fi 

Of course t may be absent from the functions /i, /z, fa, in the right-hand 
members of (90. 3) just as x was absent from the right-hand member of 
the equation y" = sin y — 1. 

If the functions fi, fz, /s are easy to differentiate, the first five values 
of X , y , z needed to start the computation can be found from the initial 
conditions and from the Taylor expansions of x , y , z, each as a function 
of ^ ; if the three functions are not easy to differentiate, the beginning 
values must be found by the Milne method or by the modified Euler 
method, using short intervals of t. 


91. Systems of Simultaneous Equations. We have already dealt with 
certain systems of simultaneous equations in reducing a second-order 
equation to two first-order equations. In the present article we consider 
more general types of simultaneous equations. 

Example, Required the numerical solution of the simultaneous equations 
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dx dy 

-tt — 2 TT + ^ = sin t 
(JLt cLl 


d^x dy 
dt^ dt 


-\-2x — y = In cos f , 


with the initial conditions x = y = 2, — =0, when ^ = 0. 

at 

Solution. To integrate these equations numerically, we first write them 
in the forms 

(2) V = i — sin <), 

(3) ^ — y — 2x + y -[- In cos L 

To get the starting values we use the Taylor-series method. Assume 

(4) * = + -^ + -^+^+-^+-^ + - ■ • 

/.X , • . , , y<,V' , y"'oi* , y''ot^ , y''\i’^ , 

(5) y = y<- + yo'+ ”^+ + '• 

From (3) we get 

y = i{x + x — cost), y = i(2 + i-t-sin0, etc.; 
and similarly from (3), 

X = y — 2x y — tan t, x'” = y — 2 x + y — sec® t, etc. 


Using the initial values and putting < = 0 in the above equations, we hav« 


yo = l/2 

yo = i(i — 1) = — 1/4 
yo = i(i + i) =3/8 


i’o = 2 — 2 + i = 1/2 
i„ = 1/2 — 1/4 = 1/4 
x"'o = — 1/4 — 1 + 3/8 — 1 = — 16/ 


^ ,y\ = -^, y'\ = — ^ = — 7/i 6, ^ 9/32. 


Note that these successive coefficients are found alternately by a zigzag 
procedure, starting with y, then going to x, then back to y, etc. 

On substituting in (4) and (5) the coefficients just found, we get 


^ ^ 4 24 64 ** 1930 ^ 2660 ^ ’ 


y — 2 + g t 8 * 16 ^ 384 ' 3840 * 46080 ' ’ 
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Also, from (6), 


1 -I K 7 

x= t + - — 4- 

9 . “ fi 1 fi ^ 


On putting t = — 0.10, — 0.05, 0.05, 0.10 in (6), (7), (8), and using 
the initial values, we get the values of x, y, and x given in the first five lines 
of the following table. The corresponding values of y and x are found 
from the given equations (2) and (3), by using the proper values of x, y, 
i, and t. 

The computation is continued by means of the following formulas: 

(9) Ax = hlx +~ Aii + ~ A.,x + -1^.2], 

for starting a new line; 

(10) Ax = h[i — ^-A,x—^ A.x~-^ Aai— ^ A^x^, 

for finding Ax in the new line : 

(11) y = \ {x X — sin r), for finding y in the new line; 

(12) x = y — 2x y -\-\n cos ty for finding x in the new line ; 

(13) Ai = ft [2 — ~ A.i- — i AoX—^A,x—~ A.x], 

for checking Air in the new line; all formulas to be used in the order given. 

92. Conditions for Convergence. The conditions for the convergence 
of the numerical solution by approximating polynomials can be arrived at 
most easily by means of the Picard process. 

For the simple equation 

f^ = y' = fix,y) 

the Picard process converges to the true solution provided 



1 dy I max 


in the region of integration * ; and in the case of the two simultaneous 
equations 

* The proof of these conditions will be found in the first edition of this book. 
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% = Ux,y,t) 


the conditions for convergence are 


M < 


dU 

dx 


max 


. + 


3 /= 


dx 


and M < 


Imax 


in the region considered. 


dy 


[max 


+ 


dU 

~dy 


max 


Now sinbe a polynomial can be made to approximate any continuous 
function to any required degree of accuracy, it follows that the approxi- 
mating polynomial used for the numerical solution of a differential equation 
can be made to approach the Picard solution by taking }i sufTiciently sihall. 
Then since the polynomial solution can be made to coincide with the Picard 
solution as closely as desired, it is evident from the geometric significance 
of partial derivatives that the conditions for the convergence of the poly- 
nomial solution are the same as for the Picard solution when h is suffi- 
ciently small. 

In the simple equation 

y' = i{x,y) 


the numerical })rocess of solution will fail in a region where 


dy 


00 ; 


and in the case of simultaneous equations the process wdll fail in a region 
where any one of the partial derivatives 

d_h ^ a/2 

dx^ dx ^ dy ^ dy 

becomes infinite. Before starting the numerical solution of a differential 
equation, it is well to examine the partial derivatives for the range or 
region to be covered. 


III. THE DIFFERENTIAL EQUATIONS OF EXTERIOR BALLISTICS. 

93. The Simplest Case — Flat Earth with Constant Acceleration of 
Gravity. This book is not primarily concerned with the derivations of 
differential equations, but inasmu^-h as one of the main fields of application 
of numerical integration to the solution of differential equations is that 
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of exterior ballistics — the science which deals with the motion of a pro- 
jectile after it leaves the gun — , it seems not amiss to sketch briefly the 
derivation of the fundamental differential equations of the motion of pro- 
jectiles. The projectile will be considered as a material particle acted on 
by the force of gravity and by a tangential retarding force due to the 
resistance of the air. In the present article the acceleration of gravity will 
be assumed constant in magnitude and direction, which means that we are 
assuming a flat earth and that the projectile does not reach a great height. 
The air resistance is proportional to some (variable) power of the velocity, 
which power itself depends on the velocity. The equations will be derived 
first by taking 0 as the independent variable and then by taking time {i) 
as the independent variable. 


Case I. Talcing $ as the Independent Variable. Let a projectile of 
weight W be fired with an initial velocity Vq at an angle of elevation 
let V denote the velocity of the projectile at any point in its path and let 
0 denote the inclination of the velocity vector at that point; and, finally, 
let p denote the radius of curvature of the trajectory (path) at the point 
in question and let kv^ denote the air resistance at that point. Then 
resolving forces along the tangent and the normal at P (see Fig. 17), 

we have by the fundamental law of dynamics: 


( 1 ) 

( 2 ) 


— kv” — W sin 9 = 


g dt ’ 


- - W cos 6 — 


W ^ 
9 P 



Fig. 17 
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From (2), p = - 

( 3 ) 

Then from (1)^ 

and since 

we have 

or 

( 4 ) 


g cos 6 


ds 

; and since p = — we have — 


ds 


de. 


de 


g cos B 

dv f ^ n \ n \ 


dv dv ds 


dv 


dt ds dt ^ ds ^ 


dv f ^ n \ n\ 


ds 


vdv 




g cos 0 ' 


Equating the values of ds from (3) and (4) and simplifying slightly, 
we obtain 

dv 


( 5 ) 

where c — lc/M\ 


dO 


V tan 6 = c sec* (9, 


This (‘qua! loll (o) is frc*qiientJy called the fundamental equation of 
exterior liallist lo. When n is an uifv(jv}\ the equation becomes the well- 
known Bernoulli type of linear differential equation and can be solved for 
i; as a function of 0. 

The values of the exponent n for various velocities are as given below : 


0 < V < 790 ft./sec., 
790 < v < 970 ft./sec., 
970 < v < 1230 ft./sec., 
1230 < V < 1370 ft./sec., 
1370 < t; < 1800 ft./sec., 
1800 <i V <i 2600 ft./sec., 
2600 <v < 3600 ft./sec.. 


n=2 
n — ^ 
71= 5 
n = 3 
n = 2 
n= 1.7 


For 71 = 2 and the initial conditions 6 — <f>, v — v^, the solution of 

(5) is 


or 
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^ = CC08*ff j^sec <f> tan — sec ^ tan 6 + ] 


sec <l> + tan <f>~ 
sec 6 + tan 6 . 


Vq^ cos ^ <f> * 

To find in terms of 0 the rectangular coordinates of any point on the 
trajectory and the time of flight of the projectile, we have 

dx dx ds - 

dS ds dO ^ q 


dy dy ds . ^ 

do ~ ds ' do 

^ dt ds 1 . . 

^ ‘d0 ~v 


— p sin 6 = — n COS 0 


sin^ , 

;r = — — tan 9 . 

cos 9 g 


sec d . 

9 


Integrating these three expressions from ^ to ^ we get 


(93. 2) 


9J<f> 

= -^ rVta. 

gJ<p 


tan 0 dO 


i I V sec 6 dS . 

^ 9 J0 

These integrals can be computed by Simpson’s Eule as soon as the values 
of the integrands are known for equidistant values of 6. In the case n = 2 
the values of v can be found from (93. 1). 

Case II. Talcing Time {t) the Independent Variable. In most 
ballistic calculations it is better to take time as the independent variable. 
To find the differential equations of motion for this case, we resolve forces 
in the horizontal and vertical directions. Then (see Fig. 17) 

— kv^ cos 6 = — X 

9 

W 

— kv^ sin 6 — TV = — y, 

9 ^ 


^'9 

: r" cos 0 


R cos 6, — 


V cos 6 = X 

V 


i;” sin ^ — g — — R sin 0 


V sin 0 — g 


-^y-9. 
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where R — Hence the fundamental differential equations in rect- 

angular form are 


(93. 3) 


X — 


R 


y = 


R . 

--y-9^ 


These equations are connected by the velocity v = V + y* and must 
therefore be integrated simultaneously. 


94. The General Case, Allowing for Variation in Air Density with 
Altitude. The ballistic equations thus far given do not permit the decrease 
in air resistance and gravity with altitude to be taken into account and are 
therefore inadequate for modern gunnery. To allow for variation in air 
density with altitude it has been the practice in this country to write the 
fundamental differential equations in the forms : * 

(94.1) 
where 


Here G{v) is a function of the velocity alone, H {y) is a function of the 
altitude alone, and (7 is a constant whose value depends on the weight and 
shape of the projectile. The function 11 {y) is 


= — Ex 
— — Ey — g, 

.. Cr{v)H{y) 


zz: g-0. 00010361/ 


when the altitude y is in meters. The function G{v) is much more com- 
plicated. These functions G{v) and H (y) have been tabulated for a wide 
range of values of v and y.l 


95. Methods of Finding the Starting Values. The use of Taylor^s 
series in starting the computation of a trajectory by numerical integration 
is out of the question, because of the difficulty in finding successive dcriva- 
ties of the given differential equations. The Kunge-Kutta method is 
likewise unsuitable for obtaining I he necessary starting values. The Milne 


t See Tables la and Ic in Exterior Ballistic Tables Based on Numerical Integration, 
Vol. I, Washington, 1924. 

* The reduction of the ballistic equations to the form (94. 1) and the integration 
of them numerically was first done by F. R. Moulton. 
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method can be used for the simple problems not requiring the E-innction, 
but in the general case of projectiles fired with high velocities and reaching 
considerable heights, the starting values must be found by one of the 
following methods: 

(a). The Modified Euler Method. This method, as previously stated, 
will give starting values in any problem, provided short steps (intervals) 
are taken. In starting the computation of a trajectory, two consecutive 
values of the required functions, in addition to the initial values, are com- 
puted by taking very short intervals of time. From these three values 
first and second differences are formed. Then the computation is con- 
tinued by means of formulas (86.1) and (86.2). After the first five 
values are found, they are checked by formulas (86. 3), (86. 4), and (86. 5). 


{h). Barkers Hyperbolic- Arc Method. In recent years a new and 
entirely different method of starting the computation of trajectories has 
been devised by J. E. Barker.* Having in mind the fact that the path 
of a projectile fired through the air has a vertical asymptote at no great 
distance from the gun (usually at a distance of two to three times the 
horizontal range), Barker conceived the idea of replacing the trajectory 
near the origin by the arc of a hyperbola passing through the origin and 
having a 'Vertical asymptote at a horizontol distance c from the origin. 
The equation of such a hyperbola is of the form 


0 ) 


y = 


X {ax ^ ) 

c — X 


where a, b, and c are undetermined parameters. These parameters are 
to be determined by the condition that the hyperbola shall have third-order 

dif d~v 

contact with tlie trajectory at the origin. This means that 

for the livficM'bola must equal the same three derivatives of the tra- 
jectory at the origin. The hyperbola wdll then approximate the trajectory 
extremely closely in the neighborhood of the origin and may therefore be 
used for computing starting values for the trajectory in that region. 
From ( 1 ) we get by differentiation 

2acx -|- he — ax- 


( 2 ) 


dy 

dx (c — x)^ 

d-y _ 2ac- + 2bc 
dx^~ {c — xy 

d^y Qc{ac b) 

— {c — xy 


Mathematician at the U. S. Naval Proving Grounda, Dahlgren, Va. 
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To find the corresponding derivatives of the trajectory, we have 


d-v 2 0^^ „.dd/dt 


^=tan^ 

ax 

o .<9 
sec- 0 . 

X 


= 6 sec B — — S see 0 ■ — - . 

X X cos 6 

^ . ds ds/dt V , 

But since and p 


g cos 6 


by Art. 93, we have 


— = ^ — T- , from which B sec B — — — . Hence 

g cos B V 


B 


Also, 


d-y 

dx~ 


9 


V I cos B 


d V cos B 


d^y _ d ( 9\ __ d , 

dx^ dx\ d'-J dt^ 9-^ ) 


dx 


d Vx 


2g'x ^ 


.. 1 

X ■ — 
X 


_ o. iL _ _ 2gE 

.1^ x^ 

IS'ow equating these three derivatives to the corresponding derivatives 
in (2), putting x = 0, x =. Xq, B — E — E^y and then solving the 
resulting equations for a, fc, and c, we get 


and 


3 Xo 

2 'El 


-L 3 Xo 4. 
^ ~ 2 Wo 


a — — ( - ) — tan <t>. 

X^EoXo/ 


On substituting these values in (1) we get y in terms of x. 

But since the independent variable in the ballistic equations is t, we 
must have x and y in terms of /. To get the required relations we go 
back to the relations 

tZ'-y 2c (ac h ) g 

dx^ (c — x)^ x^ 

Solving for x, separating the variables, and integrating, we have 
V — 2c(ac^b) C (d — dx = \^ g C dt. 

0 "X o 

From this we find 


r 1 __ / 2V— 2 («c+ b) 

L V \/ (7< -I- 2 \/ — - i 


Wgi + 2V— a(ac + &) 


)“] 
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Eeducing the right-hand member to its simplest form and then replacing 
a, h, and c by their values as previously found, we get 

y q \ ^ t {Ept -f- 6) 3^0 n t I 3^ ^ ~1 

^ ^ 2 ■ (Eot + ^y~ 2 LFot + 3'^(Fot + 3)d 

When this value of x is substituted in (1), the value of y becomes 

» = U W + 3)- 
which is equivalent to 


( 4 ) y 


9 ~l~ 4 j?oy o) 

8E\'^ ^ ^ AE\ 8E\{E4 + 8y 


Differentiating (3) with respect to t and simplifying, we get 
(95.1) ^ = + . 

which may be written as the binomial series 


10 


(95.2) x^x,ll-{E,t) + ^ (^oO^* • •] 


27 


On differentiating (4) with respect to t, we find 


S;( ‘ + ¥) +S;( > + f ) + ' +f ) •■ 


In view of (95. 1) and the fact that yo/fo = tan <#>, the third term on the 
right is equal to i tan <f). Then on replacing the middle term by its 
binomial expansion and reducing the right-hand member to its simplest 
form, we get 


(95. 3) y = i tan </> — y^[l — {l/2)(Eot) + (5/18) {Eoty— (5/36) (Eot)^ 

+ •••]■ 

From (95. 1) or (95. 2), f is readily found. Then this value of x is 
used in (95. 3) to find y. Formula (4) is not convenient for finding y. 
When the values of y_i, yi, and have been computed by means of (95. 3), 
the values of y are more easily found from the quadrature formulas 
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(95. 4) 


Uq 24 ( ~i~ 191^0 5ui ^2^ 

At r • • • 

- U^ = Uo+— L + 13 (Wo + Wi) — W 2 ] 

U2 = Uo+^ {uo+ 4iii + U2), 


where u stands for any variable, u its time derivative, and At( = h) is the 
interval between equidistant values of t. Note that t in (95. 1 ), (95. 2), 
and (95. 3) may be either positive or negative, but At in (95. 4) is always 
positive. 

The values of x and y found from (95.1), (95.2), and (95.3) are 
extremely accurate, but they can usually be slightly improved by iteration 
by means of formulas (95. 4). The computation of a trajectory is started 
by the Barker method as follows : 

Close approximations to i-i, Xi, X 2 and i/_i, yi, yz are first found by means 
of (95. 1) and (95. 3), using t = — At, t = At, t = 2 At, These and 
j /^8 are then substituted in the given differential equations (94. 1 ) to get x.i, 
X 2 , and y.i, yi, ^ 2 - Then tiicse x^s and tfs are substituted in the right- 
hand members of (95. 4) to get improved values of x_i, Xi, Xg, and y_i, y^, 
yz. If there is any reason for thinking that these last values can be 
improved, the iteration process through (94.1) and (95.4) is repeated. 

When the final values of y_i, 3 ) 1 , and yz have been found, they are sub- 
stituted in the right-hand members of (95. 4) to get the values of y_i, 
yi, y-y. If the values of x_i, Xi, Xz are desired, they can be found in a 
similar manner. 

When two or three sets of values of the several quantities mentioned 
above have been found by the process outlined, differences up to the second 
or third order will.be available. The computation is then continued by 
means of the difference formulas ( 86 . 1 ) and ( 86 . 2 ). The application 
of the Barker method to a simple trajectory will be shown below. 

The actual computation of a modern high-altitude trajectory cannot be 
given here, because of lack of space for the necessary tables. The reader 
will find such a problem worked out completely in the Encyclopedia 
Britannica, Twelfth Edition (1922), Vol. XXX, p. 390. A simple trajec- 
tory will be worked out below. 

Note. Since the advent of high-altitude rockets of the V -2 type, the 
motion of projectiles in a vacuum has become of practical importance. 
A simple and direct treatment of this astro-ballistic problem will be found 
in the following paper : '' The Actual Path of a Projectile in a Vacuum,” 
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American Journal of Physics, Vol. 13, No. 4 (August, 1945), pp. 253-255. 

A thorough and masterly treatment of the motion of projectiles and 
rockets under all conditions will be found in Ballistics of the Future, by 
Kooy and Uytenbogaart, 1946. 

Example. A bullet is fired at an angle of 38° 30' with the horizon and 
with an initial velocity of 780 feet per second. Assuming that the air 
resistance varies as the square of the velocity of the bullet and that the 
resistance coefficient is — 0.00005, find the range, time of flight, and angle 
of fall of the bullet. 


Solution. Let 6 denote the angle which the velocity vector makes with 
the horizontal at any instant. Then the equations of motion are 

d?x 

-yj- = — P cos 0 = — 0.00005t;^ cos 0, 
dP 

= — Psin ^ — a = — 0.00005v^ sin 0 — o, 
dP ^ ^ 


where i2(=: 0.00005i;^) denotes the tangential retardation. Since v cos ^ 
= — dx/dt and v s‘m 6 = Vy =: dy/dt, the equations of motion can be 

written in the form 


dP 


■ 0.00005V 

d z 


d^y 


0.00005V 

dt 


— 9- 


These can be reduced to a system of first-order equations by putting 
. dx . ^ dx d^ .. ^ d-y 


Taking g = 32.16 ft./sec.^ we then have the system 


" dx 

U 

dx 

dt 

dy 

It 

dy 

L ~di 


X = — 0.00005vi:, 

y 

y = — 0.00005vy — 32.16. 


To start the numerical solution of this system of equations we first 
find the initial values of the velocities and accelerations. Thus, 
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Then 

= — 0.00005(598.83 X 755.36) = — 22.62 
= — 0.00005(460.40 X 755.36) = — 49.55. 

These values differ from the preceding values by only one unit in the last 
figure, and they give the same new values for Ax and Ay. Hence we con- 
sider them correct for the present. The increment in y for the second 
interval is 

^ 1( 4«.88 + 460.40 ) 66. 


Hence the new value of y is 

yi/2 = 119.80 + 116.66 = 236.46. 

(b). Barker Method. To find the second and third lines of the table 
by the Barker method we first note that 


and 


Eo = 0.00005 X 780 = 0.039 
tan = 0.79544 


Then on substituting t = — \ in (95. 1) or (95. 2) we get i.i = 616.43. 
Now substituting in (95.3) this value of and i = — we get 
y_i = 498.41. The value of is then 

v.i = V (616.43)2 + (498.41)® 792.72. 

These values are now substituted in the given equations to get the corre- 
sponding accelerations. Thus, 


x_i = 


y-i 


792.72 X 616.43 

20,000 

792.72 X 498.41 

20,000 


■ — 24.43, 


32.16 = — 51.91. 


These quantities are placed in the first line of the trial table (Table A, 
p. 288). The quantities in the third and fourth lines of Table A are found 
in exactly the same manner by substituting t = \ and i = respectively, 
in formulas (95.1) and (95.3) or in (95.2) and (95.3). 

We next check these computed trial values by substituting the accelera- 
tions in the right-hand members of (95.4). Thus, taking A< = J, 


= 610.44 — i [9(— 24.43) + 19(— 23.81) ^ 5(— 23.20) — 22.61] 
= 616.47, 

= 485.56 — ~ [9(— 51.91) + 19(— 51.10) — 5(— 50.30)— 49.54] 
= 498.44, 
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and similarly for the other values of x and y. The corresponding v’s are 
then computed and then new accelerations are found from the given 
differential equations. 

It will be observed that the improved values in the second table (Table B) 
differ very little from the first computed values. A second iteration by 
formulas (95. 4) makes no improvement whatever except in the case of yi/ 2 , 
which it changes from 460.41 to 460.40. We therefore take the values 
in Table B to be correct. 

We are now ready to find y for t = \ and t = These are found 
from (95.4) as follows: 

= 0 + -^ [— 498.44 + 13(485.56 + 472.88) — 460.40] = 119.80 ft. 
y o 

yj 0 + i (485.56 + 1891.52 + 460.40) = 236.46 ft. 

It will be noted that nearly all these values in Table B are identical 
with those found by the modified Euler method. 

Now having three complete lines of the table, we can form first and 
second differences of the quantities x, y, i, y. Then we can continue the 
computation by integrating ahead and back-checking. For this purpose 
the following formulas are applied in the order in which they are written : 

(1) Ay = ydt — A/ ^y, + | Aijl. + + | A,y„ + J . 

for finding y in a new line ; 

(2) Ax = J" ' xdt = A! + I AiXnJ , 

for finding x in the new line; 

(3) V = Vi* + y* ; 

(4) y = — 0.00005vy — 32.16; 

(5) x = — O.OOOObvx; 

(6) Ay = J*^ = A/ [^y„ — iA,y„ — -^Ajyn — ^Aaj/nJ , 

for checking and correcting the value of y found by (1) ; 

(7) Ai = ^ xdt = A^ — AiXn ^ y 

for checking and correcting the value of x found by (2) ; 
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-51 92 
- 51.10 
-50 31 
- 49.55 


-24 44 
-23 81 
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498 44 
485 56 
472 88 
460 40 


I 


616 47 
610.44 
604 56 
598 84 


119 80 
236 46 

792 78 
780 
767 53 
755 37 


Table B — First Iteration Values 
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^ /. J. ^ ^^2/- - ^^3yn - L A,2/, ] , 

for finding the new y after the correct value of y has been obtained. In 
these formulas the instant in (1) and (2) is the same as U in (6), 
(7), and (8). 

The increments in x for the several intervals can be found by means 
of the formula 

(9) Ax = ^ ^ xdt — At ^Xn — 3 g y 

after the correct value of x has been found for the interval considered. 
Since only the range is called for in this problem, however, it is not 
necessary to find x at the end of each interval. The range is more easily 
found by means of Simpson’s Eule, as follows : 

X = J xdt = — [Xo “f- 4(Xi -|- X 3 ‘ in-i) 

+ S(X2 + ^^4 + ■ ' ‘ + in- 2 ) + in]> 
where T denotes the time of flight. 

The table is continued with the time interval At =: ^ sec. until five 
lines have been computed. 

The computed values of Ay and Ax are then checked by applying 
formulas (86.6), (86.4), and (86.3) to the acceleration values in the 
fifth line, checking the interval ^ 1 = 0 to ^ = 1/4 by (86. 5), the second 
interval by (86.4), etc. The checks show that all computed values are 
correct. 

Since the correct values are given at the first trial for t — t — and 
^ = 1, we start a now table with At = ^ sec., using the previously computed 
values of x, y, x, y, and v for the lines i — 0, t — t — Here, again, 
the correct values of the several quantities are given at the first trial in 
the fourth and fifth lines of the table. So we double the interval again 
and start a new table with At — \ sec., using the previously computed 
values for lines t — 0, ^ = 1, < = 2. This new table is continued up to 
the line t = S. Then the interval is doubled once more and a new table 
started. The computation is continued with this interval until the problem 
is finished. In most cases only one correction is necessary for x, y, and 
V, and none for y and x. 

When using formulas (1), (2), (6), (7), (8), with At = 2 the student 
should not round off the numbers within the brackets before multiplying 
through by the factor 2 ; for by so doing he would double the error due to 
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rounding. He should also be careful not to discard fractional quantities 
of less than half a unit in the second decimal place until he is sure that 
the algebraic sum of these quantities is less than half a unit in the second 
decimal place. Attention to these matters, instead of being a waste of time, 
will frequently save the time and labor of recomputing a whole line in the 
table. For example, let us check the value of Ay in the line for t = 26. 
We have 

Ay = 2 [— 376.89 + ^ (47.27) — ^ (3.04) - ~ (0.15)] 

= — 763.78 + 47.27 — ~ (3.04) — ~ (0.15) 

6 12 

= — 753.78 + 47.27 — 0.507 — 0.012 = — 707.03. 

By rounding off before multiplying by 2 we have 

Ay = 2[— 376.89 + 23.64 — 0.25 — 0.01] = — 707.02, 

which differs from the previous value by a unit in the last figure. 

The preceding remarks apply with even greater force when At = 4. 

The final results of the computation for this problem are given on the 
following page. 

To find the time of flight we replace the terminal part of the trajectory 
by a parabola through the points corresponding to f — 22, i z=z 24, and 
t =1 26. Hence y is to be a quadratic function of i, and we find this func- 
tion by constructing a table of differences and employing Newton’s inter- 
polation formula (II) of Art. 21. 


t i 

y 

^i?y 

Aay 

22 

1389 97 



24 

780.54 

-609.43 


26 

73 51 

-707 03 

-97 60 


Putting y 0 in that formula, we have 


Vn + A,y„u + {u‘ + u) =0. 

73.51 — 707.03U — 48.8(m® + w) = 0, 
or 

48.8u* -f 755.83W = 73.51. 

_ _ 755.83 + 765.26 _ 9.43 
■ ■ “ ~ 97.6 97.6 


= 0.0966, 
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and 

t = U + }iu = 2^-\-2X 0.0966 = 26.19 sec. 

We next compute the range by means of Simpson’s Eule. The horizontal 
distance covered during the first two seconds is, taking h = = \ sec., 

X = J[610.44 + 4(598.84 + 577.32) + 2 X 587.82 + 567.32] 
1176.3 ft. 

For the interval from < 2 to ^ = 26, taking = 2, we have 

X = J[567.32 + 4(531.69 + 476.21 + 434.09 + 399.07 
+ 366.90 + 335.36) + 2(501.77 + 453.93 + 416.00 
+ 382.81 + 351.12) + 319.58] = 10,181 ft. 

Hence the horizontal distance covered in the first 26 seconds is 10181 -|- 1176 
= 11,357 ft. 

To find the distance covered in the remaining 0.19 second we assume that 
the horizontal acceleration will remain at — 7.90 for 0.19 sec. Then the 
change in velocity during this time will be ( — ^ 7.90) X 0.19 = — 1.5. The 
horizontal velocity at the end of 26.19 seconds with therefore be 319.6 — 1.5 
or 318.1 ft./sec., and the average velocity during this fraction of a second 
is (319.6 + 318.1)/2 == 318.8 ft./sec. Hence the horizontal distance covered 
in the last 0.19 sec., is 318.8 X 0 19 = 61 ft. The total range is therefore 

X = 11357 + 61 = 11,418 ft. 


If we compute the increments in x for the several time intervals and add 
them as we go along, as was done in the case of y, we shall find the same 
value for the range as found by Simpson’s Rule. 

If o> denote the angle of fall, then 

tan o) — "v" • 

X 

We have already found the value of x for t = 26.19. To find y we assume 
that the second difference in y will be the same for the interval ^ = 26 
to t = as for the preceding interval. Then for the next two seconds 
we shall have = 1.64. Hence for one second the change in y will be 
0.82, and for 0.19 second it will be 0.82 X 0.19 = 0.16. The vertical 
acceleration when t = 26.19 will therefore be — 22.85 + 0.16 = — 22.69. 
The change in the vertical velocity during the last 0.19 second is then 


— 22.85 — 22.69 


X 0.19 = — 4.3. 


o 
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Hence y = — 376.9 — 4.3 = — 381.2. 

. , —381.2 

and ^0^^ 

The terminal velocity is 

V =z Vi:* + ^ = V"(318.1)2+ (381.2)2 = 496.5 ft./sec. 
The value given by formula (93. 1) is also 496.5. 


IV. OTHER METHODS OF SOLVING DIFFERENTIAL EQUATIONS 
NUMERICALLY. 


96. Milne’s Method. A simple and reasonably accurate method of solving 
differential equations numerically has been devised by W. E. Milne.* It 
does not employ differences, but uses two quadrature formulas instead — 
one for integrating ahead by extrapolation and the other for checking the 
extrapolated value. These formulas are derived from Newton’s formula 
(I), p. 63. 

That formula in terms of y' and u is 


(1) „•=/. + Ay. + AV, 

u{u — l){u — 2){u — 3) 

1- 24 ■/ 0 -r - 


where u = - , or x = x„ + hu. Integrating this formula over the 
h 

interval Xq to Xq ^h, ot u — 0 to u — 4, we have, since dx — h du, 


= J' ” y'dx — h^^ {y\-\- i^^y'o 

6 ^4 

= h(^y\ + 8Ay'„ 4- y + y A’y'„ + || A‘y'o) • 


Now replacing the first, second, and third differences by their values as given 
on p. 53 and simplifying, we get 

* “ Numerical Integration of Ordinaiy Differential Equations,” American Mathe- 
matical Monthly, vol. 33 (1926), pp. 4i>i>-460. Also, Numerical Calculus (1949), 
pp. 135-139, and Numerical ISolution of Differential Equations, 1953. 
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Ah 

% - y (2y'i - y'. + 2y'a) + ^ aav, . 

But here Ay = y 4 , — yo. Hence 

( 2 ) y* = yo+f i2y\ - y'. + 2y\) + . 

This is Milne's extrapolation formula. 

To get the checking formula we integrate (1) from Xq to Xq 2 h, or 
from u = 0 to u = 2. Then 

Ay = A (2y'o + 2Ay'o + ^ A^y'o — ^ AVo) . 

Now replacing Ay'o ajid A^y'o by their values as given on p. 53, we. have 

— ^ (y'^ "1“ "^y'^ "i“ y'^^ — ^ ^Vo • 

But in this case Ay — y 2 — yo* Hence 

(3) yi = yo+Y (y'o + ^y'l + ^ ^*y'o • 

This is the second of the Milne formulas and is seen at once to be 
Simpson's Rule. The terms involving A^y'o are not used directly in the 
application of (2) and (3), but only as indicators of the accuracy of the 
results. 

Since Xq,- • ■ , may be any five consecutive values of x, formulas 
(2) and (3) may be written in the more general forms 

Ah 

(4) yn.i = y«-8 + Y (^y '"-2 — y'"-i + 2y'„), 

(5) yn+l — yn-i (y n-l + 4ry'n + y^n+l), 

which are the final forms of the Milne formulas. 

The principal part of the error in the value of y computed by these 
formulas is easily found as follows : 

Let and y^^J denote the values of y given by (4) and (6), 

respectively. Then if the value of h is such that the inherent error in each 
formula is given by its remainder term involving A*y'y the true value of y 
at X = Xn+i is either 


y = ynll 
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or 

» = AY. 

Equating these values of y, we have 

y + If * ' 

or 

ylV = -|^ ^ay = 29(- Aay) = 29f;„ 

where E 2 denotes the principal part of the error in (5). From this we get 

( 6 ) E,=^{y:,ll-yiV,). 

This simple formula enables the computer to test the accuracy of each com- 
puted result. If we write 

(7) D = ynll — yn*l 

it is well to provide a column for D just to the right of the column of y% 
or whatever quantity is being computed ; and the behavior of the D’s should 
be observed as the computation proceeds. If the D^s become erratic, look 
at once for a mistake. 

It will be observed that Milne’s method requires the four starting values 
yn- 3 , y'n- 2 , y'n-iy and y'n. These values an to be found by the starting 
methods previously described in this book. Milne’s method will now be 
applied to three types of differential equations. 

(a) EqmitioJis of (he First Order, To tabulate the solution of the first- 
order equation 

(a) ^ — 

we first find three consecutive values of y and y' in addition to the initial 
values. Then we find the next value of y by (4), substitute this in (a) 
for the new y\ and then substitute the new y' in (5) to get the corrected 
value of the new y. If the corrected value agrees closely with the extrap- 
olated value, proceed to the next interval. 

If the corrected value differs appreciably from the extrapolated value and 
no error can be found in the work, compute E 2 by (6). If Eo is too small 
to affect the last digit to be retained, all is well ; proceed to the next interval. 
But if E 2 is large enough to affect the last figure to be retained, the value 
of h is too large and must be reduced. 
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Example 1, Tabulate by Milners method the numerical solution of 


with 





^0 = 0 , yo = 1 . 


Solution. On page 250 we found the starting values given in the first 
four lines of the accompanying table. To start the fifth line we have by ( 4 ) 


w 

y 

y ' 

0 

1.0000 

1.0000 

0.1 

1.1103 

1.2103 

0.2 

1.2428 

1.4428 

0.3 

1.3997 

1 .0997 

0.4 

1.5836 

1.9836 

0.5 

1.7974 

2.2974 


0 4 

t/o4 = 1 + [2(1.2103) — 1.4428 + 2(1.6997)] 

= 1.5836. 


Then 


y\ 4 = 0.4 + 1.5836 = 1.9836. 


Now checking t/o 4 by (5), we have 

yo.« = 1.2428 [1.4428 + 4(1.6997) + 1.983C] = 1.6836, 

which is the same value of yo 4 as found by (4). Hence we consider it 
correct. 

Proceeding now to the next line, we have by (4) 

yo 5 = 1.1103 [2(1.4428) — 1.6997 + 2(1.9836)] = 1.7974. 

Then 

y'o 5 = 1.7974 + 0.5 = 2.2974. 

Now checking by (5), 

yo 5 = 1.3997 + [1.6997 + 4(1.9836) + 2.2974] = 1.7974, 

which is the same value of y^ 5 as previously found. 

( 6 ) Equations of the Second Order. Since formulas ( 4 ) and ( 5 ) are 
merely relations between a function and its derivative, similar formulas 
hold when the function is y'. Hence we may write 
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( 9 ) 


y n+i — y'n -1 + g {y''n-\ + 4y"n + y"n+i)- 


The general equation of the second order, when solved for , 


dx^ 


may 


be written in the symbolic form 

(b) y'^ = f{x,y,y^). 


When four starting values of y and y' have been found by some method, 
the solution is continued as follows : 


1. Use (8) to find a first approximation to the new y\ 

2. Substitute this new y' in (5) to get a new y. 

3. Substitute in the given equation (b) the new y and new y' to get an 
approximation to y'\ 

4. Check the new y' hy (9), using the new just found. 

5. If the y' just found by (9) does not agree with that first found by 
(8), substitute the corrected y' in (5) to get a corrected y. 

6. Then substitute in (b) the corrected y and y' to find a corrected y". 

7. Substitute this corrected y" in (9) to get a better y', and then 
substitute this last y' in (5) to get a better y. 

8. As a final check, apply (6) to the last two consecutive y'^s and y’s. 
If the error is too groat, decrease h. 

Examine. Compuio by Milners method the last line of the table on 
page 264. 

Solution. Substituting in (8) the appropriate values of 0 and $, we have 

tfs = 0 + L (_ 5.782 + 2.758 — 5.120) -- 0.5429. 

15 

Now substituting this ^5 in (5), we get 

= 0.2851 4- ^ (— 0.287!) — 1.6844 — 0.5429) = 0.2435. 

Then substituting Or, and 0^ in the given equation 6 — — 0.2^ — 10 sin 
we get 

‘^5 = 0.1086 — 2.4110 = — 2.3024. 

As a check on ^5 we next use (9) with the ^5 just computed. We have 

e^ = — 0.2879 + (_ 2.758 — 10.240 — 2.302) == — 0.5429, 

60 
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which agrees with the value previously found. We therefore take these 
values to be correct. 

The reader will note that formula (8) was used only once, and would 
not have been used again even if the two values of 0 had not agreed on 
the first round. 

(c) Simultaneous Equations, The solution of simultaneous equations 
by Milne’s method can be explained best by an example. 

Example 3. Compute by Milne’s method the values of x, x, y, and y 
in the seventh line of the table on p. 273. 

Solution. We first find x^ by means of formula (8). Thus, 
i, = 0+^ [2(0.5102) —0.5156 -f 2(0.5162)] = 0.1025. 

O 

Now using this value of i in (5), we get 

X, = 1.0025 + [0.0509 + 4(0.0767) + 0.1025] = 1.0102. 

O 

Substituting these values of i and x in the given equation y = ^(x~{-£ 
— sinf), with f = 0.2, we have 

yj = i (1.0102 4- 0.1025 — 0.1987) = 0.4570. 

Now using (5) to find y, we have 

y, = 2.0488 + [0.4768 + 4(0.4665) ) + 0.4570] = 2.0955. 

u 

We next substitute in the given equation x = y — 2x y ha. cos t the 
values of x, y, and y found above, with t = 0.2. Then we get x = 0.5120. 
Finally, we check the whole procedure by means of (9). We thus have 

it = 0.0509 + [0.5136 + 4(0.5162) + 0.5120] = 0.1024. 

O 

Since this value differs from the extrapolated value by only one unit in 
the last figure, we take it as correct. 

Additional lines of the table can be' computed by exactly the same pro- 
cedure as employed above. 

The reader will note that the values found by Milne’s method are 
the same as those found by the difference method, formulas (86.1) and 
( 86 . 2 ). 

97. The Runge-Kutta Method. This method was devised by Runge * 


C. Runge, Maihematische Annalen, Vol. 46 (1896). 
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about the year 1894 and extended by Kutta f a few years later. It is 
unlike any of the methods explained in the preceding pages. Here the 
increments of the function (or functions) are calculated once for all by 
means of a definite set of formulas. The calculations for the first incre- 
ment, for example, are exactly the same as for any other increment. 

The formulas for several types of differential equations are given below. 

(a) First-Order Equations. Let dy / dx =: f {x, y) represent any first- 
order equation, and let h denote the interval between equidistant values of 
X. Then if the initial values are Xo, yo, the first increment in y is computed 
from the formulas 

f(xo,yo)h, 

f (^0 2’ 

f(xo + h, + ki)h, 

“I" ^^2 2^8 “I" ^«)> 

taken in the order given. Then 

Xi = Xo+ h, j/i = yo + Ay. 

The increment in y for the second interval is computed in a similar 
manner by means of the formulas 

=f(xi,yi)h, 

= +|-, +f^) 

= y.+y)‘. 

^^4 = f{Xi + h, 3/1 + ks)h, 

Ay HZ o(^l H” ^^2 + 2^3 + ^ 4 ), 

and so on for the succeeding intervals. 

It will be noticed that the only change in the formulas for the different 
intervals is in the values of x and y to be substituted. Thus, to find Ay 
in the nth interval we should have to substitute x„_i, yn-\, in the expressions 
for ki, k 2 , etc. 

In the special case where dy/dx is a function of x alone the Runge- 
Kutta method reduces to Simpson^s Rule. For if dy/dx = f{x), then 

t W. Kutta, Zeitachrift fiir Math, und Phya., Vol. 40 (1001). 
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hi = f(xo)h, 
h = f(xo + I) h, 

^4 =f{xo + h)h; 

and therefore 

(‘^o) -f + /(^o + 

= f + ‘1/ ^ ^0 + + /(^O + ^0^ > 

which IS the same result as would be obtained by applying Simpson^e Eule 
to the interval from Xo to Xq -{- h if we take two equal subiatervals of 
width h/2. 

(b) Second-Order Equations of the general type 

— y') 

are integrated ^top by step by means of the following formulas, applied 
in the order given: 

— hf (Xfi) yny y n) 

lC 2 — hf {Xn , Vn - y' n 3/^n + ^ ) , 

k2 = hf{Xn + -, yn + -yn-h-K 3/ n + " ) ^ 

ki =z hf (Xn hy yn 4" ^y'n + TT 2/^" 4“ ^ 3)7 

Ay h[y'n 4~ ^ (^i + ^.; + 

Ay = — (A^i 4“ ^^2 4“ ^^3 4“ ^ 4)7 

t) 

where n = 0, 1. 2, • • • . 

For the special second-order equation 

y'' = f{^,y)y 
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the increments in y and y' are found f^om the formulas: 

hi = hf{xn,y„), 

hi = hf {Xn ~ , yn + -^y'n+ — hi), 

h3 = hf{x„ +h, yn+hy'„ + 

Ay = fc[y'„ + |- (ii + 

Ay' = ^ (fci + 4A;, + fcj). 

(c) Simultaneous Equations. In a pair of simple simultaneous equations 
of the type 

§^fAi,x,y) 

^=U(t,x,y) 

the increments in x and y for the first interval are found from the 
following formulas: 

2*0, yo)^t, 

t.-/. (<0+~, + y„ + |)A^ 

= /i ^<0 + 

( ^0 “h ^0 “1“ ^3? yo "f" I'd) 

Ax ^(^1 ~ 1 ~ ^^2 “h 2 Ar 3 -j- . 

(4) 

Zi zz: /^(Zo, yo)^^} 

A.- = /a ^<0 + -g- , "I" ’ yo + A<, 

h = fi(jo + Y> + ^‘’+2')^^’ 

I4 ~ f2{t'0 ^0 -f* ^ 3 ? yo 

~ 4(^1 ” 1 “ ^^2 ”t“ “h ^4)* 



The increments for the succeeding intervals are computed in exactly the 
same way except that toj Xq, yo are replaced by ti, Xi, yi, etc. as we proceed. 
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The simultaneous equations 


dx 


= h{x,y,z) 


dz 

dx 


= f2ix,y,z) 


are solved by formulas (4) by changing t to x, x to y, y to z, and 
putting At = h. 

The derivation of the formulas used in the Runge-Kutta method is a 
somewhat lengthy process and will not be given here.* 

The inherent error in the Runge-Kutta method is not easy to estimate, 
but is of the order \ and is therefore of the same order as that in 
Simpson’s Rule. 

We shall illustrate the method by applying it to an example to which 
the previous methods were applied. 

Example. Solve the equation 


with the initial conditions Xo = 0, y© = 1. 

Solution. Takiug h — 0.1, we have 

= 0.1 X 1 == 0.1, 
k2 = 0.1[0.05 + 1.05J = 0.11, 

= 0.1[0.05 -f 1.055] = 0.1105, 
k^ — 0.1[0.1 + 1.1105] = 0.12105. 

/. Ay = ^[0.1 -f 0.22 + 0.221 + 0.12105] = 0.11034. 
Hence Xi=Xq-\- h = 0.1, zn yo + = 1 + 0.1103 = 1.1103. 

Then for the second interval we have 


k^ = 0.1 (0.1 + 1.1103) = 0:12103, 

k2 = 0.1 (0.1 + 0.05 -f 1.1103 + 0.06051) = 0.13208, 

^3 = 0.1 (0.1 + 0.05 + 1.1103 -f 0.06604) = 0.13263, 
k^ = 0.1 (0.1 + 0.1 + 1.1103 + 0.13262) = 0.14429. 

Ay = 4(0.12103 -f 0.26416 + 0.26526 + 0.14429) = 0.13246, 

• See Kutta, loc. cit.y or umerischea Rechnen, by C. Runge and H. Kbnig, pp. 287- 
294 and 3II-313. 

t See Kutta, loc. cit., or Numeriache Integration, by F. A. Wlllers, pp. 91-92. 
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and X 2 = 0.2, y 2 = 1.1103 + 0.1325 = 1.2428. These values for and y^ 
are correct to four decimal places. The computation can be continued in 
this manner as far as desired. 

98. Checks, Errors, and Accuracy. Attention has already been called 
to the use of formulas (86. 2), (86. 3), (86. 4), and (86. 6) for checking the 
computed change in a function over a single interval. A formula has also 
been given for checking the results found by Milners method. Simpson^s 
Rule furnishes a convenient and reliable means of checking the summation 
of any function over an even number of intervals. For example, the 
decrease in the horizontal velocity of the bullet in the example of Art. 95, 
from t = 2 to t = 26, is 

^20 

Ai = J xdt = — [x 2 + 4 (X 4 + Xs + ^12 + ^16 + X 20 + X 24 ) 

-f- 2(Xe -[- Xxo -j- Xi4 -[- ^18 -|- ^ 22 ) “1“ ^^ 20 ]^ 

or 

Ai = §[— 19.52 + 4(— 16.26 — 11.88 — 9.43 — 8.27 — 7.91 — 7.88) 

+ 2(— 13.77 — 10.46 — 8.72 — 8.02 — 7.88) — 7.901 = — 247.76. 


Hence 

X2e = 567.32 — 247.76 = 319.56, 

which differs from the value in the table by only two units in the last digit. 
The fifth figure in all these numbers is uncertain, probably worthless, but 
the two methods certainly check within a unit in the fourth figure. The 
values of y and y may be checked in a similar manner. 

A single error in any one of the quantities i, y, and y will persist 
throughout the computation in the column in which it occurs, but its 
effect will usually not increase as the computation continues. An error 
in the acceleration will likewise persist and will affect in some degree all 
the other computed quantities, but the effect may not be serious. An 
error in the differences of the acceleration and in the second, third, and 
fourth differences of the other functions will soon disappear, and its effect 
on the final results will usually be negligible. If several errors are made, 
they will probably neutralize one another to a considerable extent, but it 
is possible that they may accumulate sufficiently to affect seriously some 
of the later results. 

As an example of the effect of a single error near the beginning of a 
computation, it may be stated that the example of Art. 89 was first com- 
puted throughout by starting with an error of two units in the last digit 
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of 6 for t — 0.05 sec. The maximum error in any subsequent value of 
(9 up to < = 2.1 was five units in the last digit, whereas the greatest error 
in any later value of 0 and 0 was only two units in the last figure. 

An error of more than a unit in the last digit of a computed result 
can usually be detected by inspection of the second, third, and fourth 
differences of that result. If these higher differences run smoothly — 
that is, vary in a regular fashion without sudden changes in magnitude 
or sign — , it is quite certain that no error has been made ; but if the 
third and fourth differences become grossly irregular, the student had 
better stop and look for an error at once. The error may be located 
approximately by ihe method explained in Art. 17. The computer should 
watch the behavior of the higher differences as he goes along, so as to 
detect an error as soon as possible after it appears. 

The safest plan to insure accuracy is to take h so small that fourth 
differences will be negligible to the number of figures desired in the final 
results. When fourth differences are negligible, the application of formula 
(86.2) as many times as it will effect improvement will usually insure 
that the error is less than half a unit in the last figure retained. Since 
these half-unit (or less) eirors are as likely to be positive as negative, 
they are largely neutralized in the calculation process. Hence it i^ not 
worth while to consider them in estimating the accuracy of a final result. 

Whatever method is used in tabulating the numerical solution of a 
differential equation or a system of equations, the successive differences of 
all comi)uted quantities should be computed and recorded. The behavior 
of the differences will show at a glance whether a mistake has been made 
in the computation or whether the value of h is too large. 

99. Some General Remarks. The methods given in the ])reccding j)ages 
are believed to be sufficient for the numerical solution of all ordinary 
differential equations having numerical coefficients and sufficient initial 
conditions. Equations higher than the second order have not been treated, 
but equations of the third and fourth orders can be handled by the methods 
given. All that has to be remembered is that formulas for integrating 
ahead and starting a new line are to he applied to ihe derivative of 
highest order in the equation {or equations) and the various differences 
of that highest-order derivative. 

The most important matter in the numerical solution of a differential 
equation is getting correct starting values. These can be found by 
several methods, but in some of them there is no certain means of deter- 
mining the accuracy of the results found. When the starting values are 
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found by the modified Euler method, the value of h should be so small 
that one or two repetitions of the averaging process will give the final 
result for that value of h. Lik(»wise, when the starting values are found 
by Taylor’s s(‘ries, h should be so small that only three or four terms of 
the series have any effect on Ihe computed result. 

Kelialile starting values can be found by ilu^ Runge-Kutta method in 
many cases, but usually at a greater expenditure of labor than by other 
methods. 

The Milne method (ff finding starting values is accurate and reasonably 
short. Wlum tlie derivative of the given highest derivative can be found 
without difficulty, is a good method for coiniiuting the starting values. 

After correct starting values have been found, there are two good nuffliods 
for continuing the computation : the method em[>loying diffidences, formulas 
(8(). 1) and (8fl. 2) for examjd(‘, and the metliod of Milne. Which of these 
is preferable probably dejiends on the taste and (‘(piipment of the conifiuter. 
Tn the ditferenci^ method much of the work can be done mf'ntally and with 
very litth* effort. On the oth(*r hand, if the computer is equifiped with a 
computing machine and is exjiert in using it, he may find the Milne 
method short(*r and easier. 

The Runge-Kutta method is tod laborious for tabulating many steps of 
a numerical solution. 

The Picard method gives the solution theoretically when the derivative 
is any type of function, but the method is of limited practical value 
because of the difficulty frequently encountered in performing the required 
successive integrations. 

The reader has observed that the numerical solution of a differential 
equation by any method involves considerable labor. But the numerical 
methods also have certain redeeming features in their favor ; for they pro- 
vide a means of obtaining solutions to problems wliich could not be solved 
otherwise, and they also give a complete record of the behavior of the 
functions within the regions considered. In some problems the exact 
analytical solution may involve more labor tlian the numerical method if 
certain information is desired. The following example will illustrate this 
point. 

Suppose the differential equation 

£y = yrri 

dx ^ + 3: 

is given, with initial conditions a:© == 0, — 1, and it is required to find 
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several corresponding values of x and y. The given equation can be solved 
by putting y — vx, separating the variables, and integrating. The result, 
for the given initial conditions, is 

I In (a:= + r)+tan-' (|) = ^ • 

To find pairs of corresponding values of x and y from this equation we 
could substitute the desired values of x and then solve the resulting equation 
for y. But this resulting equation will always be a complicated transcen- 
dental equation which can be solved only by trial — by Newton^s method 
or otherwise. The labor of solving this equation for even a single value 
of y would probably be as great as that of computing several tabular values 
by numerical integration. The numerical method might therefore be the 
easier in this example. 

The numerical solution of a differential equation, however, will give no 
information concerning the function outside the range of computed values, 
whereas the exact analytical solution will enable us to predict the behavior 
of the function for any values whatever of the independent variable. For 
this reason the solutions of differential equations expressing natural phe- 
nomena should always be obtained in analytical form if possible. 


EXERCISES XII 


1 . Solve the simultaneous equations 


dx ^ ^ dy 

-=.2x + y,- = x- 


3y, 


with the initial conditions a: = 0, y = 0.5 when t — 0. Compute the first 
six lines of a tabular solution. 

2. Compute the first six lines of a tabular solution of 


d^^O ^ ^ do ^ ^ ^ 

dv^ + Tt + ^ - 0’ 


with the initial conditions 6 = 30°, = 0, when t = 0. 

dt 


3 . Use the method of Art. 90 to solve the equation 


d-e 

dt^ 


+ 0.9 sin ^ = 0, 


with the initial conditions 6 ~ 
six lines of the solution. 


dO 

5°, when t =: 0. 


Tabulate the first 
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4 . Use the method of Art. 89 to solve 

0.0002959 


di^ 


fO.Ol 


/ dr\^ 

\di) ' 


dr 

with the initial conditions r — 1, — = 0, when t = 0. Compute the first 
six lines of a tabular solution. 


5 . The motion of a bullet is determined by the equations 

d’x dx 

— = — 0.000035t’ -- 
ar dt 

d-y dy 

— — 0.0000351; — 32.1 6. 

dr dt 


If the initial conditions are v == 800 ft./sec., ^ = 692.82 ft./sec., = 40( 

dt dt 

ft./sec. when i ^ 0, find the horizontal range and time of flight of the 
bullet. 


6 . Compute the first ten lines of a tabular solution of the simultaneous 
equations 

d'^^x _ 0.0002959a: 

'dP 

d'^y 0.0002959y 

Ip' ~~~ 7^ ’ 

with the initial conditions x — 0.31, y == 0, ~ = 0, ^ = 0.034, when 

at at 


t = 0. Here r — y^. 
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THE NUMERICAL SOLUTION OF PARTIAL 
DIFFERENTIAL EQUATIONS 

100. Introduction. One of the greatest iiochIs in applmd niaihoiiiatics 
is a goneral and n'nsonablv short nn'thod of solvjng partial dilTorcntial 
equations by numerical methods. Several nu'lhods have been proposed 
for meeting this need, but none can be called entirely satisfactory. They 
are all long and laborious. 

Soon after Runge discovered his metliod of solving ordinary differential 
equations, Cans ^ extended the metliod to jiartial diff(‘rential equations 
with given initial conditions. Some years later, Willers^ ('Xtended the 
improved Runge-Kiitta method to the solution of partial differential equa- 
tions witli given initial conditions. These mid hods are slow and laborious 
and have not come into general use. 

Certain tyjies of boundaly-^alue problems can la* solved by re])lacing the 
differential equation by the corr *sponding difference equation and then 
solving th(‘ latter by a process of iterafion. This method of solving jiariial 
diffmvntial equations was devised and first used b} L. F. Richardson.-'^ It 
was lat(‘r ]mpr()\(‘d by IT. Tiicbmann and furtlun- iinprovi'd mon nM'ently 
by Sliorlley and AVcllcr.'* Th(‘ }>rocrss is sIo^^, but giv«‘s good results on 
boundary-\ aliie jiroblems winch satisfy LaplaccV. RoissonV, and several 
other partial diffeiential equations. A stroiig ])oint in it^ favor is that the 
conifiutation can }>e doin' by an automatic sc(pienct‘-conl roJh'd calculating 
machine. 

A somewhat similar method is the relaxation nn'tliod d(‘Vis('d IjV H. V. 
Son^hwell.^^ Tins method is shorter and morc' f]r'>Ml)b‘ than tin' it(‘ration 
method, but is not adapt(nl to automat n* nun bine eomputation. In both 
of these methods the ajijiroximate solution fd a jiartial difli'reiitial equation, 
witli given boundary \ allies, is found by finding tin' solution of tin' eorre- 
S]>ondmg jiartial diff('renee I'qiiation. 

Zrifsrhrif t fur ^f atlu'tmttih inid Pln/'ijl, \U)1 4S ( HlOii 1 , pp 304 'U)0 

~Xu7nrt'isrhrlnf((pnltoii (102.3). T>p 00 100 

** Transartions of the Koyal Soi-iotv A, 210 (1010), pp. 307 3.'>7 

* .Sit 7 iingsl)t*T i( hte (h'r niatli ph\ ^ Kla'^'^f* der Ilayt'nsclo' Akad, Miiuchen, 
p. 38.7 

^’Journal of Applied Physirs, Vol 0 (1038;, j)p .334 348 

^ Relaxation Methods tn Thrnrcfiral J^hifaifs 
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I. DIFFERENCE QUOTIENTS AND DIFFERENCE EQUATIONS. 


101. Difference Quotients. A difference quotient is the quotient ob- 
tained by dividing the difference between two values of a function by the 
difference between the two corresponding values of the independent variable. 
Thus for a function f{x) of a single variable the difference quotient is the 


familiar expression 


fix + h) — fix) 


whose limiting value is the deriva- 


tive of f{x) with respect to x. A difference quotient is thus an approxi- 
mation to the derivative, the approximation becoming closer as h becomes 
smaller. 


Partial-difference quotients of the second and higher orders are best 
constructed with reference to a network of points in the a:i/-plane for a 
function of two variables and in space for a function of three variables. 
For a function u{Xy y) of two variables, let the xy-plane be divided into a 
network or lattice of squares of side h, by drawing the two families of 
parallel lines 

X — mh, 771 = 0, 1, 2, • • • 

y = nh, n 0, 1, 2, • • • 


as indicated in Fig. 18. The points of intersection of these families of 
lines are called laificu points. 

With reference to Fig, 18, the forward first-difference quotient of u(x,y) 
with respect to x is 


( 101 . 1 ) 


— 


u(x h, y) — v(x, y) 

'h ^ 


and the backward first-difference quotient with respect to x is 


( 101 . 2 ) 


Ur — 


u(x, y) — u(x — y) 
h 


The second-difference quotient of u{x,y) with respect to x is the 
difference quotient of the first-difference quotients (101.1) and (101.2). 
Hence we have 


u{x h.y) — u(x,y) u(j, y) — u(t -- h, y) 


(101.3) 


Ux 


Ux 


u{x + h, y) - - 2u(x, y) -f u{x — h, y) 
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The first- and second-difference quotients of u{x,y) with respect to y 
are found in exactly the same manner and are 


( 101 . 4 ) 

and 

( 101 . 5 ) 


.. _ + h)—u{ x,y) __u{x,y) — u{x,y — }i) 

wy- ^ ^ 

_ u{x, y-{-h)— 2u(x, y) + u(x, y — h) 

Uyy — . 


Y 



Higher difference quotients are found in exactly the same manner except 
that additional lattice points must be used. 

Difference quotients of a function u{x,y,z) of three variables arc found 
by the same process as used above. Thus for the second-difference quotient 
with respect to z we have 

(101.6) U-, = ^ + ^) — y, g) + u(x, y,z — h) 
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The reader will note that the differences used in finding all these 
difference quotients are central differences. When central differences are 
used, the inherent error made by replacing a second derivative by a second- 
difference quotient is proportional to if h is small. This fact can be 
shown by replacing the terms u{x h, y) and u{x — h,y) in (101.3) 

d^u 
dx^' 


by their Taylor expansions and then comparing ujx with 


102. Difference Equations. The difference equation corresponding to 
a given differential equation is found by replacing the derivatives by the 
corresponding difference quotients. The functions y) and u{x,y,z) 
occurring in the difference equations are defined only at the lattice points, 
but we can make these points as close together as desired by decreasing h. 
In order to get simple procedures for solving the difference equations we 
shall assume that the given differential equation is exactly satisfied by the 
difference quotients. The magnitude of the inherent error resulting from 
this assumption will be investigated later (Art. 104). The difference 
equations corresponding to several well-known partial differential equations 
aie given below. 


(a) Laplace's equation for two dimensions, 

d^v d^v 

0J-' ?y- 


0 . 


Eeplacing 


d^V 

dx^ 


and--- - bv ujt 
dy^ 

u(x h, y) 


and respectively, we get 

— y) + u(x — h^y) 
h:^ 


, y -j- //) — 2u(x, y) -f- u(x, y — h) 

from which 


(102. 1) u{x,y) = \\u{x + h,y)-\-u{x,y-\-h) 

-\-u(x — h, y) + u{x,y—h)^. 

This equation shows that the value of u at any interior lattice point is 
the arithmetic mean of the values of u at the four lattice points nearest it. 


(6) Laplace's equation for three dimensions, 
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Replacing the second derivatives by the second-difference quotients as given 
by (101. 3), (101. 5), and (101. G). and solving for u{x,y,z), we get 

(2) u(x, y, z) ~ -}.[vj(x + li.y,z) + u(x, y -f- h, z) + u{x, y,z + h) 

+ u(x — /!,y.z) + u(x.y — h, z) + u(x, y,z — A)]. 

This equation (2) sliows tliat the value of u at any interior lattice point 
in space is the arithmetic mean of the values of ii at the six lattice points 
nearest it. 


(c) Poisson's equation in two dimensions. 

Replacing and and respectively, as given by (101.3) 

and (101. 5), ve get 
(102.2) u(x,y) 

= y) + ui>r. y+h) + n(x~-h. y)+u(x. y—Jt)]+7r}pp(x,y). 


Here the value of u at an iniiu'ior lattice point depcnids not only on the 
of the adjacent points but also (‘Xpliculy on tlie \alue of h and the 
function fj{x,y). 

(d) The equation of heat conduct ion in a plane, 

% - .r 

at \rx- cip ) 


Here i d(‘not<*s tinn^ and T denot(‘.s tiunperatun* at any time and place, or 
T — T{x. ?/, / ), and ns a constant. If the tein])eratur«^ of the jilane area 

07 " 

has reached a steady state, so that = 0, tlnni tin* above (‘(piation r(‘duces 

vi 


to Laplace’s equation. 

If the steady state has not been reached, the temjierature at any point 
d(‘pends on the time. Hence the difference quotient at any lattice point 
at time t is 


7"(.r, y / A/) — T (.r, ?/. 1 ) 


The second-difference quotients Tj, and at any instant {t fixed) are 
given by (101. 3) and (101. 5) if u is replaced by T. Hence on replacing 
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the derivatives in the heat equation by the corresponding difference 
quotients, we get 

T{x, + — t) 


ill 

from which 
T(x,y,t + /at) 

= T(x, y,t) + ~M[T(x + h, y, t) + T{x, y + h,t)+ T(x — h, y, t) 

+ T(x,y — h,t) — AT{x, y, <)] 

^2 

Since M is an arbitrary increment of time, we may set M Then 

4a^ 

the above equation reduces to 
(4) T{x,y,t -[■ i^t) 

= \iT{x-\-h, y, t) + T(x, y + h, t) + T(x — h, y, t) + T(x,y — h, <)]• 

This equation gives the temperature at any interior lattice point at time 
t as the arithmetic mean of the temperatures of the four adjacent 

lattice points at time t. If the temperature has reached the steady state, 
we have 

(102.3) T{x,y,t) 

= i[T(x + h, y, t) -|- T{x, y T{x — h, y, t) + T{x,y — f)]. 

Other types of partial differential equations can be replaced by partial 

difference equations by proceeding as in the above examples. 

II. THE METHOD OF ITERATION. 

103. Solution of Difference Equations by Iteration. We consider a 
process of solving Laplace’s equation in two variables and with given 
boundary conditions. For simplicity we assume that the function u{x,y) 
is required over a rectangular area. We therefore cover the area with a 
network of squares of side h, as shown in Pig. 19. 

Since the boundary values of the desired function are assumed to be 

known, we denote them by a’s, as indicated in Fig. 19. The values of the 



,2 r + K y, t) — 2T(x, y, t) + T(x — h, y, t) 
T(x, y-\-h,t) — 2T(x, y, t) + T{x, y — h 

I ^ 
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required function at the interior lattice points are unknown, but in order 
to start the iteration process by equation (102. 1) we compute rough values 
for them as shown in the solution of Example 1 below. 

We start the iteration process by computing an improved value of Uj 
by means of formula (102.1), the new or improved value of Ui being 



denoted by u\. Then we proceed to improve Uz in the same manner, and 
so on with all the other interior lattice points. The traverse, as it is 
called, proceeds over the network in the order in which the points are 
numbered. Thus we have 


U\ = J(W2 + + ^24 + Wt) 

u'z = \{uz+a^ + u\ + Ws) 


= J(U8 + u\ + a23 + Wia) 

z= J(t^» + u\ + + W14) 


t^'24 = J(ai2 + w'l8 + ^''23 + fll4). 


Note that improved values are used as soon as available in computing 
improved values for points ahead. 
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The process outlined above is repeated as long as it produces any improve- 
ment in the w^s. For the second traverse we would start with 

= 4 (^^2 “h ^2 + ^24 

etc. 

In solving partial-difference equations by the iteration process, it is 
advisable to start with a coarse net (large value of h). Then when itera- 
tion gives no further improvement in the u^s, the whole process is repeated 
with a finer net (smaller value of A) and the iteration carried on until 
no change occurs in the 

Example 1. Solve the Laplace difference equation for a square region 
and having the boundary values shown in Fig. 20. 

Solution, We start with a coarse net by dividing the given square into 16 
smaller squares, as shown in the figure. 

To get initial values for the interior points of the network, we first find 
a value for at the center of the square by taking the mean of the four 
boundary values at the ends of the heavy lines drawn at right angles 
through the center. Then we find the values for the centers of the four 
large squares into which the given square is divided by the heavy lines 
through the center. These values are found by taking the means of the 
values at the ends of the diagonals of the large squares.* The values for 
the four remaining interior points lying on the heavy central lines are 
found by taking the means of the four adjacent points in each case; that is, 
the four nearest points lying on the horizontal and vertical lines through 
the points considered. The computation of some of the interior values is 
shown at the bottom of Fig. 20. 

Now having all the boundary values for the network and rough values 
for the interior lattice points, we are ready to start with the iteration 
process. Beginning with the first interior point in the upper left-hand 
corner of the square, we proceed to the right until the last interior point 
on the line is improved. Then we drop down to the next line and proceed 


* This method of taking the mean of the values of the function at the ends of 
the diagonals of a square is perfectly legitimate, because if we make a transforma- 
tion of coordinates by rotating the x- and y axes through 4;’)'’, the ends of the 
diagonals are on the new coordinate axes; and from the transformation equations 


a 


1 1 d*u , d^u d"u , d^u 

— y') - y = -t- y’) it follows that ^ + g^ . 


(See E. 


B. Wilson’s Advamed Calculus, p. 112, Ex. 2,"), or A^allee-Poiissin’s Cours dWunlyse 
Infinitesimale, I {4th Edition), p. 159, Ex. 6.) Hence u satisfies Laplace’s equation 
in the new coordinates, and Equation (102.1) is therefore valid here. 
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from the given boundary values of Fig. 20. The computed interior points 
will then be no more accurate than the new boundary points. 



Fig. 21 


Remark. The reader should keep in mind the fact that the computed 
values at the mesh points in a network are determined by two things : 

1) . The given differential equation. 

2) . The set of given boundary values. 

Hence if the boundary values are known to only two or three significant 
figures, it is useless to compute the interior points to more figures. 
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Example 2. Solve- the Laplace difference equation for a square region 
having the boundary equations shown in Fig. 24.* 

Solution. Here the value of u on the boundaries is given by definite 
analytic expressions which may be evaluated at any point on the boundary 



Y 

Fig. 22 


to any desired degree of accuracy. Such boundaries also make it possible 
to express u analytically as a Fourier series and thus enable us to compare 
the numerical solution with the Fourier solution. 

We start with a coarse net by dividing the given square region into 

* The given boundary values in this example are quantities of zero dimensions, 
or pure numbers. Hence the computed values at all interior mesh points will like- 
wise be pure numbers. 
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16 squares. Approximate values of u at the mesh points are found as 
already explained in the preceding example. Five applications of the 
iteration process gave the results shown in Fig. 22. 

We then halve the value of h and make a new computation, as indicated 
in Fig. 23. The initial values at the new interior mesh points are found 



Fig. 23 

as explained in the previous example. All initial values are written above 
the corresponding mesh points. The final values for the interior mesh 
points are written below the points. The iteration process was applied 
20 times to get these final values. By noting the time required for one 
traverse, it is an easy matter to estimate the time required for solving 
this problem. 

Additional values of the function in the region of the network can be 
found by the following procedure: 
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Find the values at the centers of the squares by applying formula (102. 1) 
to the final values just obtained for the net points. Then find the value 
of the function at the midpoints of the sides of the squares by applying 
(102. 1) to the new center points and the final values at the mesh points. 



The last points to reach their stationary values were those near the 
center of the region, and it may therefore be fairly assumed that the 
values at these points are the least accurate of all; that is, the differences 
between these computed values and the true values of the function are 
greatest for these points. On the other hand^ a Fourier series for the 
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function gives its most accurate values for these points near the center. 
Hence the difference between the given computed value and the value given 
by a Fourier series for points near the center of this region will be very 
close to the true error of the computed values for those points. 

The Fourier series for W 2 . 2 , or for the point a; = 2, y = 2, is a rapidly 
converging alternating series whose value is 6.9535 correct to four decimal 
places. The approximate error in the difference equation is thus about 
6.9535 — 6.920, or about 0.03. 

Figure 24 represents the surface u = f{x,y) whose ordinates have been 
computed in this example. 


104. The Inherent Error in the Solution by Difference Equations. 

The inherent error in the difference-equation solution of a differential 
equation can be found by expressing the difference quotients in terms of 
derivatives, and this can be done by means of Taylor^s formula. 

Taylor’s formula for a function of two variables can be written sym- 
bolically in the form 

( 1 ) + + 

When k = 0, this becomes 


/(x + fe,y)=/(x,y)4-fcg+ 


I All!/ . ^ 
3 ! 4 ! 


dx* ^ 


from which 


f(x + h,y)-f(x,y) df hd^-f h^d^f h^d*f 
' '' h ~dx^ 2\dx^'^ S\dx^^ 4ldx* 

Changing h to — in (2), we get 

f(x,y)-f(x — h,y) df hd^f h^d^f h^d*f 
' '' h ~ dx 2\dx^~'~ 3\ dx^ 4! 0x‘ 


Forming the second-difference quotient by subtracting (3) from (2) and 
then dividing throughout by h, we have 


(4) 


f(x -\-h,y)— 2f{x, y) -f- f(x — h, y) d^f 2h^ d*f 

dx^ 4 ! dx* 


-|- terms in h^, etc. 


Likewise,, on putting h ^0 in (1) and proceeding exactly as above, 
we get 

f(x, y + k) — 2f(x, y) -f f(x, y — k) _ 07 2k^ d*f 

' ' k^ 4 ! dy^ 

+ terms in k*y k^, etc. 
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Putting h = h for a square net, using the notation of Art. 101 for 
second differences, and then adding (4) and (5), we get 

ia\ - L d^u 2h^ d^u 2h^ d*u . . • 14 r- . 

(6) u,, + = + terms in etc., 


dy^ ' 4 ! dx^ ' 4 ! dy* 

2h^ /d*u 0*u\ 

= 0 + — + — j + terms in h*, A«, etc., 


d^u , d^u _ 

“"“5? + V " 


by hypothesis. The error committed in writing 


u^a + Uyy = 0 is thus a power series in even powers of h, the principal 
part of the error being the first term of this series. 

Now if we solve the equation u^x + '^vv = ^ thereby neglect the 
error terms, the error in the solution will be the integral of these error 
terms; and since h is independent of x and y (has a fixed value throughout 
the integration), the integral of the error terms will be a power series in 
A*, etc. Hence when h is small the principal error in the solution will 
be the first or term. We are therefore justified in assuming that the 
inherent error in the difference-equation solution of a partial differential 
equation of the second order is proportional to A*. 

To find a simple formula for the inherent error, we have by hypothesis 

E = 

where E denotes the error and c is a constant of proportionality. Then 
for any two values Ai and A 2 of A, the corresponding errors are Ei = chi^ 

and E 2 = c}i 2 ^, from which ^ == ~ or En ~ J If A 2 = ^Ai, then 

hi \hi / 

(7) E2 = IEi. 

Let and az denote the final approximate values of the function u 
at any interior mesh point, corresponding to Ai and A 2 respectively. Then 

U Ui -}- El , U fl-2 "t" Ej2 • 

Eliminating u and taking account of (7), we get 

(8) E2 = ^{az — ai). 


This formula gives the approximate value of the inherent error at 
each intersection point of the network after two values of A have been 
used, the second value of A being half the first value. 

Since u = a 2 En, we can substitute the value of E 2 from (8) and get 


(9) u = a2 + J(a2 — tti), 

which gives a close approximation to the true value of u at any net point. 
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As aa application of formulas (8) and (9), let us consider the error 
in u at the point a: = 2, y = 2 of Example 2, Art. 103. There at = 6.836> 
a 2 = 6.920. Hence 

E 2 = i(6.920 — 6.836) = 0.028 
u = 6.920 + 0.028 = 6.948. 

This value agrees closely with the extremely accurate value given by 
Fourier’s series. 

Note. Although the Fourier series solution gives very accurate values 
near the center of the region of Example 2, it gives very poor values on 
and near the boundaries even when 12 terms of the series are used. On 
the whole, the solution by difference equations is preferable in that example 
and is obtained by much less work. 

105. Application of Conformal Transformation to Certain Problems. 

In the determination of stresses in thin plates by photo-elastic methods, 
it is sometimes desirable to transform an area bounded by circular arcs 
into a rectangular area which can be divided into a network of squares. 
The appropriate transformation is 

w = In z, 

where z = x iy ^ r(cos ^ ^ sin and w = u -{-iv. On replacing 

w and z by their values in terms of w, v, r, 6, we have 

u -j- iv — In = In r + iO. 

Hence, on equating real and imaginary parts, 

( 1 ) u = In r, V = 6. 

In order to transform the area bounded by two concentric circles and 
any two radii, denote the inner and outer radii by and r,, respectively, 
and take one boundary as the line ^ = 0 (see Fig. 25). Then from the 
first of equations (1) we have 

Ui = In ri, U 2 = In r 2 . 

The width of the transformed rectangle is Uz — Ui (see Fig. 26); and if 
the rectangular area is to be divided into squares of side h, the side of 
one of these squares is 

I. U 2 — u, _ In rz — In r, 

( 2 ) h — — — , 

' '' nn 

where n denotes the number of subdivisions of Uz — . 
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To find the subdivision points in AB corresponding to those of U 2 — «i , 
w’e write the equation = In in the form give an increment 

Att, and compute the corresponding increment in r. Thus, 

ri = 

ri + Ar = 

Ar = — 

or 

(3) Ari= rj(e^“ — 1). 

On putting Aw = A, 2/i, • • • (n — 1)A we get the subdivision points along 
AB. Note that Ar is measured from the point A on the circle r = r^. 

To find the subdivisions of the angle from ^ = 0 to ^ = ^2 we consider 
the second of Equations (1), from which 

Aw = A^. 


Since the area in Pig. 26 is divided into squares of side h we must have , 
Aw = h. Hence 


(4) 

where A^ is in radians. 


AS = h = 


In ra — In r. 


n 


> 


Having decided on the size of the squares in the transformed area 
A^B'C'D' in Fig. 26, one can compute the corresponding mesh points of 
Fig. 25 by means of Equations (2), (3), and (4). Note that the boun- 
dary ABCD of Fig. 25 is transformed into the boundary A'B'C'iy of 
Fig. 26, that a point P of Fig. 25 goes into P' of Fig. 26, etc. Note also 
that the transformation gives values of the function closer together on 
the concave side of the given curved area than on the convex side — a 
desiraWe circumstance in stress problems. 

Example. If = 2.2, rj 3.8, n — 4, find the subdivision intervals 
for r and 

Solution. From (2) we have 


h = 


In 3.8 — In 2.2 
4 


1.3350 — 0.7885 
4 


0.1366. 


Hence A^ = 0.1366 radian = 7° 50'. 

(Ar)i = 2.2(e°-"««®— 1) =0.322 

(Ar)2=:2.2(6®'2782_i) =0.691 

(Ar)8 = 2.2(6®*®®8— 1) =1.114. 


These APs are to be measured outward from the point where r = 2.2 on 
the line = 0. . 
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III. THE METHOD OF RELAXATION. 

106. Solution of Difference Equations by Relaxation. In solving the 
Laplace difference equation by iteration, we employed the relation 

Mo = i(Ui + «2 + Ws -I- M.), 
or 

U 2 -\- Uz + U 4 , — 4i/io = 0 

until the equation was satisfied at any interior lattice point of the network. 
Except in the final stages of the process this equation is only approximately 
satisfied, the approximation becoming closer as the iteration process con- 
tinues. Let Qq denote the residual, or discrepancy, at the lattice point Uq, 
so that 

(106. 1) Qo = Ui + U 2 + Uz + U 4 — . 

A similar residual equation holds for any other interior lattice point. 

To solve the Laplace difference equation by the method of relaxation 
we divide the region into a network of squares, write down the known 
values of the function at the net points on the boundary, and then compute, 
estimate, or assign values for the function at all interior net points, just 
as was done in Example 1 of Art. 103. The next step is to compute the 
residuals at all interior net points by means of equation (106.1). The 
object of the relaxation process is to reduce all residuals to zero, as nearly 
as possible, by continued alteration relaxation of the values of the 
function at the interior lattice points. 

But when the value of the function u is changed at a lattice point, the 
values of the residuals at the adjacent interior points must be changed by 
exactly the same amount. Furthermore, the residual at the given point 
must be changed by — 4 times the change in the function at that point. 
These facts will become clear from a consideration of equation (106. 1) 
and an appropriate figure. 

Let Fig. 27 represent a portion of a lattice network. Consider the 
point (73. The residual at this point is 

(2) Qrn = n-\-h-{-l + r — ^m. 

If m is altered by an amount Am, Qm is necessarily altered by some amount 
A^m. Hence 

Qm + ^Qm = n-\-h + l + r — 4(m + Am). 

Subtracting (2) from this equation, we get 
(106.2) A^,n = — 4Am. 



344 


SOLUTION OF PARTIAL DIFFERENTIAL EQUATIONS [Chap. XII 


The change in the residual at C3 is thus — 4 times the change in the 
function at that point. 

Let us now see what happens to the residual at C2 when m is changed. 
The residual at C2 is given by 

(4) G* — 

A change in m necessarily changes Qi according to the relation 
Qi -|- AQi — m Am q — 4Z. 
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Fig. 27 

Substracting (4) from this equation, we get 
(106.3) AQi = Am, 

It is thus apparent that when any functional value is altered (relaxed), 
the residuals of the adjacent interior points must be changed by an equal 
amount. The relations (106.2) and (106.3) must be strictly observed 
every time a functional value is changed. When the residuals are changed 
as required by (106.2) and (106.3), their resultant values will always 
be the same as those computed by formula (106. 1). 

Arithmetical mistakes are exceedingly apt to occur in working a problem 
by the relaxation process, due mainly to the fact that the computer will 
forget to correct some of the residuals at the adjacent points or else will 
make mistakes in combining the new alterations with the previous residuals. 
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Hence the computer must he extremely careful to make all required 
corrections arising from a given point before he goes on to the next point. 
We shall explain the relaxation method further by applying it to the 
two examples worked in Art. 103. 


7 


3 


4 


S 



21 


I9.2S 


I7.S0 


1S.7S 


14 


Example 1. Solve Example 2 of Art. 103 by the method of relaxation. 

Solution. We take from Fig. 22 the boundary values and the approxi- 
mate values of the function at the interior lattice points, as shown in 
Fig. 28. Then we compute the residuals for all interior points by formula 
(106. 1). The relaxation process may be started at any point, but it is 
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advisable and customary to begin near the center of the lattice area and 
at the point having the largest residual. Then proceed to the point having 
the next largest residual, and so on. Furthermore, in order to “ liquidate ” 
a residual at any point, the increment of the function at that point must 
have the same algebraic sign as the residual and must be one-fourth as 
large. Hence to find the required magnitude of the relaxation at any 
point we divide the residual at that point by 4. 

The largest residual in Fig. 28 is at the point C3. Hence we relax u 

at that point by the amount = 0.274. Then according to equations 

(106.2) and (106.3) we must add — 4 X 0.274 to the residual at (73 
and add 0.274 to the residuals at the four adjacent lattice points as 
indicated in the figure, the results of these additions being recorded as the 
new residuals at the affected points. 

The next largest residuals are at B2 and Bi. Hence we relax at these 
points by the amount — 0.164 and correct all affected residuals according 
to equations (106.2) and (106.3). Note that we record the new value 
of the function at the relaxed point as soon as the relaxation is made. 

The greatest remaining residuals are at 1)2 and i}4. So we relax at 
these points by — 0.110. Then we relax at B3 by the amount — 0.014 and 
at D3 by 0.014. 1)2 and 1)4 are next relaxed by 0.004, and then J52 and 
B4 are relaxed by — 0.003. Then relax 1)3 by 0.002 and B3 by — 0.001. 
Now relax B2 and B4 by — 0,001. Finally, relax B3 by 0.001. No further 
improvement is possible without decreasing the size of the mesh squares. 
It will be noted that the final residuals satisfy equation (106. 1), and that 
the final values of the function at the interior mesh points are the same 
(with one exception) as those found by the iteration process in Fig. 22. 
No computation by the relaxation method is finished until the final residuals 
are checked by (106. 1) and found to satisfy that equation. 

The reader who is studying the relaxation method for the first time 
should work the above problem for himself by carrying out the compu- 
tation as outlined above. 

Example 2. Continue the solution of the above example by the relaxa- 
tion process when the value of h is halved. 

Solution. We take from Fig. 23 the values of the function u on the 
boundaries and at all interior mesh points, and enter them in Fig. 29 as 
shown. Then we compute by formula (106. 1), the residuals at the interior 
points. The relaxation is started at B2 and BS by relaxing at these points 
by — 0.041. The mesh-point values having the next largest residuals are 
then relaxed and the process continued until no residual exceeds 0.002 in 
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magnitude. It is not possible to reduce all residuals to a smaller magnitude. 
The final values of the function at the interior mesh points, and their 
corresponding residuals, are recorded below the dotted lines in Fig. 29, the 
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corresponding initial values being written above the horizontal lines through 
the mesh points. It will be seen that the final values agree within a unit 
in the last digit with the values found by iteration in Fig. 23. 
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The trend of the functional values in lines D to H enabled us to speed 
up the convergence of the relaxation process to some extent, as it soon 
became evident that these functional values were continually increasing. 
Hence it was safe to overrelax in this area; that is, instead of changing 
the functional values by amounts just sufficient to liquidate their residuals, 
we change the functional values enough to produce residuals with changed 
signs and as large as they were before. The new residuals will soon be 
wiped out by increments added when adjacent points are relaxed. Such 
over-relaxation is always advisable when the residuals adjacent to a given 
point have the same sign as the residual at that point. 

In carrying out the computation for this problem some of the functional 
values had to be relaxed 14 times, by amounts varying from 0.017 at first 
down to 0.001 at the end. The number of relaxations could have been 
decreased by drastic overrelaxation in the central region of the network. 
But drastic overrelaxation should not be resorted to unless the computer 
knows about what the functional values should be in the end. 

107, Triangular Networks. Although the square network is the sim- 
plest and the one most commonly used, a network of equilateral triangles 
is sometimes more suitable for a particular problem. This is likely to be 
the case in a region having an irregular or angular boundary. Fig. 30 
represents a portion of a triangular network. 



In this case the fundamental relation which must be satisfied in the case 
of Laplace^s equation is 

( 1 ) Uo= ^ {Ui +U2 + Us + U^ + Ua + Ue), 

and the residuals are given by 

( 2 ) Qo = + Uo + v>3 + ti* + Ufi + Ua — 6uo . 
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Formula (1) is derived on pages 21-23 of SouthwelPs book mentioned 
above. Incidentally, Southwell points out, p. 24, that formula ( 1 ) is more 
accurate than (102.1). 

Formulas (1) and (2) are applied to triangular networks in exactly 
the same manner as (102. 1) and (106. 1) are applied to networks of 
square meshes. Formula (106. 3) applies unchanged to triangular net- 
works, but (106. 2) must be replaced by 

(3) = — 6Am. 

Hence to liquidate a residual at any point, we must relax by one-sixth the 
residual at that point and then add the increment to the residuals at the 
six adjacent points. 

108. Block Relaxation. Up to this point we have been altering or 
relaxing one functional value at a time. It sometimes saves time and labor 
to relax a whole group of functional values at a time. This procedure 
is advisable when the residuals at adjacent points in a region are nearly 
equal. In this case the functional values are relaxed as a block by changing 
them all by the same amount. We now consider the effect of such block 
relaxation on the residuals within the block and on those outside it. 

In Fig. 31 the group in the region surrounded by the heavy border are 
to be relaxed as a block by relaxing all functional values in the block 
(including those on the border) by an amount c. It is clearly evident 
that the residuals at interior points such as P are not altered by block 
relaxation; for although the residual at such a point is immediately 
changed by — 4c, each of the four adjacent points a, b, c, d contributes a 
quantity c to this residual and thus leaves it unchanged by the block 
relaxation. 

Such is not the case at points on the border. The residual at each of 
these is immediately changed by — 4c, but the compensating contributions 
from adjacent points depend on how many of the adjacent points are in 
the relaxed block. The residual at point My for example, is not changed, 
because the four adjacent points are all in the relaxed block. The same is 
true at Q and S. At the point N, three of the adjacent points are in the 
block and one outside it; so the residual at N is changed by — c. At R, 
two of the adjacent points are in the block and two outside it. Hence at 
R the residual is changed by — 2c. 

The amount of change in the residual at any border point on a square 
network is evidently — ru, where n denotes the number of adjacent points 
which lie outside the relaxed block. 
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Similar considerations apply to a triangular network. At all interior 
points such as P in Fig. 32 the residuals are not changed, whereas at all 
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Residuals at Border Points Changed by — nc, where 
n = Number of Adjacent Points Outside the Relaxed Block. 
Fio. 31 


border points the residuals are changed by the amount — rUj where n 
denotes the number of adjacent points lying outside the relaxed area. 
At B, for example, the residual is changed by — <, whereas at A the 
change is — 4c. 

When the functional values in a block are relaxed by an amount c, the 
residuals of all adjacent points just outside the block must also be changed 
by an amount c as required by formula (106.3). 
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In block relaxation all functional values in the block are changed by 
the same amount, but no residuals are changed except those at the points 
on the border. This procedure may thereby save much time, and it also 
reduces the possibility of arithmetical errors. 



Residuals at Border Points Changed by — rtc, where 
n = Number of Adjacent Points Outside the Relaxed Block. 

Fig. 32 


The amount by which all functional values in a block are relaxed may 
be anything desired. Southwell relaxes a block of values in accordance 
with the formula 



where 'XQ denotes the algebraic sum of the residuals in the block and m 
denotes the number of adjacent points just outside the block. (The outside 
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adjacent points should be thought of as outside connections to the block 
points. Sometimes an outside point is connected to two block points and 
is then to be counted as two adjacent points outside the block. See Fig. 33.) 

Example. Let it be required to relax as a block the functional values 
within the bordered area of Fig. 33, only the residuals being shown. 
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Here 2© = 31 + 27 + 18 + = 581 

and n = 22 

Hence 

581 
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Using round numbers, we relax all functional values of the block by 26 
and change the border residuals by — 26n, the results being indicated in 
Fig. 33. Note that the residuals of the outside points adjacent to the 
border have been changed as required by formula (106. 3). 

One may also relax a block within a larger block that is to be relaxed. 
In that case the inner block should be relaxed first and the residuals at 
outside points adjacent to its border changed in accordance with formula 
(106.3). Then the larger block (including the relaxed inner one) can 
be relaxed as desired. 

After a group of values has been relaxed as a block, the whole network 
(both inside and outside the block) may be relaxed point by point in any 
manner until all residuals have been liquidated. 

109. The Iteration and Relaxation Methods Compared. The method 
of iteration and the method of relaxation are both methods for solving 
partial difference equations with given boundary values. Although they 
reach the desired solution by different processes, both methods are of the 
same inherent accuracy. Their points of similarity and dissimilarity are 
listed ])elow. 

1. Both methods require that the bounded region be divided into a net- 
work of squares or other similar polygons. 

2. Both methods require that the boundary values be written down and 
that rough values of the function be computed, estimated, or assumed for 
all interior points of the network. 

3. In order to start a computation, the iteration method assumes that 
a functional value at any mesh point satifies the given difference equation 
(Laplace^s, Poisson’s, etc.) and thereby derives the relation which must 
exist between that functional value and the adjacent functional values. 
The process of iteration is then applied until the required relation is 
satisfied. 

4. The method of relaxation, on the other hand, recognizes at the start 
that an assumed functional value at any mesh point will not satisfy the 
given difference equation, but that there will be a residual at that point. 
The residuals are computed for all points before the relaxations process 
is started. 

5. The method of iteration starts with the upper left-hand corner of the 
network and proceeds to correct all net-work values by means of formula 
(102. 1) (in the case of Laplace’s equation), using the latest computed 
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values available. The process is carried out in a systematic and definite 
order by going from left to right until the end of a line is reached and 
then dropping down to the next line, just as in reading the consecutive 
lines of a printed page. This method of correcting the netpoint values 
is continued until no further improvements can be effected by the iteration 
process. The iteration process c^in be performed mechanically by an auto- 
matic sequence-controlled calculating machine. 

6. The method of relaxation requires that the residuals at every interior 
netpoint be computed by formula (106.1). Then these residuals are 
liquidated or reduced to zero (or nearly so) as quickly as possible by 
altering (relaxing) the netpoint values to any extent that seems advisable, 
always observing that the increment of the function must be of the same 
sign as the residual at that point and being careful to correct all affected 
residuals in accordance with formulas (106.2) and (106.3). The revised 
values of the function should also be recorded at the time of alteration. 
The relaxation process may start at any interior netpoint and jump around 
all over the bounded region, usually beginning with the numerically largest 
residuals and then proceeding to the next largest wherever they may be 
found. Because of the perfectly arbitrary manner in which the relaxations 
are made, the relaxation process cannot be carried out by an automatic 
calculating machine. ' It is an individual, hand method just as the slide 
rule is a hand device. 

7. The iteration process is slow, sure, and frequently long. The relaxa- 
tion process is more rapid, less certain, and usually reasonably short. The 
convergence is rapid by both methods at first, but becomes slow with both 
methods long before the end is reached. 

8. The arithmetic operations are easier and shorter with the method of 
relaxation. The mental effort necessary to avoid mistakes, however, is 
much greater than with the iteration method. 

9. The greatest drawback to the method of iteration is its length ; the 
greatest drawback to the method of. relaxation is its liability to errors of 
computation. Such errors can be kept out only by extreme care and 
unceasing vigilance on the part of the computer. 

10. Computational errors in the method of iteration are immediately 
evident and are self-correcting. In the method of relaxation any errors 
in the functional values remain hidden and can be brought to light only 
by application of formula (106. 1). For this reason, all interior netpoint 
values should be checked by (106. 1) several times during a long compu- 
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tation. Such checking takes time and keeps the relaxation process from 
being as short as it might at first appear. 

11. In the iteration process, attention is always fixed on the functional 
values at the lattice points; in the relaxation process attention is always 
centered on the residuals at those points. 

When a computer discovers that a mistake has occurred somewhere in 
the relaxation solution, he should not spend much time in looking for its 
origin. Instead, he should compute all residuals by formula (106. 1) and 
continue the solution with the new residuals. 

The reader should solve a problem of moderate length by both iteration 
and relaxation. Then he can decide for himself which method is pre- 
ferable in his case. 

Further information concerning short cuts, etc. in the iteration method 
can be found in the papers by Shortley and Weller; and additional informa- 
tion concerning the method of relaxation can be found in a valuable paper 
by Howard W. Emmons, entitled The Numerical Solution of Partial 
Differential Equations {Quarterly of Applied Mathematics, Vol. II, No. 3, 
pp. 173-195, Oct., 1944), and in E. V. Southweirs Relaxation Methods in 
Theoretical Physics, 1946. 

IV. THE RAYLEIGH-RITZ METHOD. 

110. Introduction. The Eayleigh-Eitz method of solving boundary- 
value problems is entirely different from either of the two methods con- 
sidered in the preceding pages. It is not based on difference equations 
and does not employ them. In finding the solution of a physical problem 
by this method, one assumes that the solution can be represented by a 
linear combination of simple and easily calculated functions each of which 
satisfies the given boundary conditions. After the problem has been 
formulated as the definite integral of the algebraic sum of two or more 
homogeneous, positive, and definite quadratic forms, or as the quotient of 
two such integrals, the desired unknown function is replaced in the 
integrals by the assumed linear combination. Then the integral, or the 
quotient of the integrals, is minimized with respect to each of the arbitrary 
constants occurring in the linear combination. 

This method is direct and short if only approximate results are desired; 
but if results of high accuracy are required, the method is quite laborious 
and the labor cannot be appreciably lessened by mechanical aids. The 
labor involved is mostly in long and tedious algebraic manipulations. 

A special and simple form of the Rayleigh-Ritz method was first used 
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by Lord Layleigh ^ ( J. W. Strutt) for finding the fundamental vibration 
period of an elastic body. It was later extended, generalized, and its con- 
vergence proved by W. Kitz.^ We shall attempt to explain it to some 
extent by applying it to two examples. 

111. The Vibrating String. Consider a tightly stretched elastic string 
or wire of length I and fixed at the ends, and assume that it vibrates in a 
vacuum. Let P denote the tension in the string and let p denote the 
mass of unit length of the string. With coordinate axes as shown in 
Fig. 34, let y denote the displacement of any point along the a^-axis. 


Y 



Then y is evidently a function of both the distance x and the time f. The 
differential equation for the motion of a point of the string is thus a 
partial differential equation and is easily shown to be * 

(1) ^ with the boundary conditions y(0) =0, y{l) =0. 

If we also impose the initial condition that ^ = 0 when ^ = 0, we find 

ot 

by the method of separation of variables that the solution of (1) is 

(2) y = C sin -y X cos \ n = 1, 2, 3, • • • . 


The vibration frequency is therefore 


( 3 ) 


27r ^ p I 



^ Theory of Bounds §§ 88, 89. 

* Journal fur die reine und angewandte Mathematik^ Bd. CXXXV, pp. 1-61; 
Oottinger NachrichteUy math.-physik. KlassCf 1908, pp. 230-248; Annalen der Physik, 
Vierte Folge, Bd. XXVIII (1909), pp. 737-780; also Gesammelte Werke Walther 
Ritz, pp. 192-310. 

* See any standard work on partial differential equations ; for example. Miller's 
Partial Differential Equations, pp. 69-70. 
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For n = 1 we get the natural or fundamental frequency. Hence for this 
frequency we have 



The higher frequencies or overtones are found from (3) by putting 
n = 2, 3, • • • etc. 

To find the vibration frequencies of the cord by the Rayleigh-Ritz method, 
we neither set up a partial differential equation nor solve one. On the 
contrary, we assume that the cord is vibrating in a vacuum and utilize 
the fact that under this condition the total energy of the vibrating cord 
remains constant. Hence the maximum kinetic energy must be equal to 
the maximum potential energy. 

The potential energy at any instant is the stored-up elastic energy due 
to stretching. It is equal to the work done in stretching the string to its 
longer form in the bowed position. Since the total energy of the string 
is constant, the potential energy at the end of a swing when the string 
comes momentarily to rest is equal to the kinetic energy when the string 
coincides with the a^-axis and is at that instant unstretched. 

Because of the elasticity of the material of the string, the deflection y 
at any point is, by Hooke’s law, proportional to the force in the y-direction. 
Hence the motion is necessarily harmonic and can be represented by the 
equation 

( 5 ) y = X sin wt, 


where X is a function of x alone and <0 is a constant. 

From Fig. 34 it is evident that the increase in length of an initially 
unstretched segment dx is ds — dx, or 


and the work done in producing this stretch is F ^ V ^ + (*)■-) d.r. 
Hence the work done in stretching the whole string is 




On expanding the radical into a binomial series and neglecting 



etc., since the slope of the string is small, we have 
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/ dy\^ 

Now replacing ( ^ j by its value found from (5), we have 

This is the potential energy of the string at any time. Its maximum value 
is when sin mt = 1, Hence 

( dy\^ 

) , 

and therefore for the whole string it is 

Replacing ^ by its value from (5), we have 


T = cos* wt. 

This has its maximum value when cos* = 1. Hence the maximum 
kinetic energy is 

Since ?7n,ax = I’max , we get 



The next step in solving this problem by the Ritz method is to choose 
for X a simple function which satisfies the boundary conditions and 
contains several parameters. These parameters are to be chosen or deter- 
mined so as to make the right member of (6) a minimum. A suitable 
expression for X in the vibrating string problem is 

(7) X = x{l — x) (ai a^x + aaX* + *•*)• 
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This is substituted for X in (6) and then the partial derivative of the 
right member with respect to each parameter is placed equal to zero. 
The result is a system of homogeneous linear equations in the unknown 
parameters. 

In order to reduce the labor' of finding the partial derivatives of the 
right member of (6), we differentiate it with respect to a typical parameter 
and derive a formula from which the linear equations are easily obtained. 
Bearing in mind that as expressed by (7), contains the independent 
parameters Ui, Uo, ‘ ' ' , we have by (6) and by using the rule for 

differentiating a quotient, 


^dX^ 


/p J 


J 

f ' X^dx / 

' 0 


or 

r ‘ f r ‘ (?) _ r A r ' = 0. 

^ 0 0 \ 0 \ / Vdi^ 0 

But, by {^)y ^ ~ Making this substitution in 

the second term of the equation above, we get 


r * XHx~ r * (^Ydx f * 

0 UCli 0 \ dx J ] 0 VQ-i 0 

Taking out the common factor X^dx, which is not zero, we have 


0a, 




or 


( 8 ) 




where Ic = —— . 


In order to increase the rapidity of convergence of the Ritz process, 
we shall move the origin of space coordinates to the midpoint of the 
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string. Then the boundary conditions will be y{ — Z/2) z=:y(I/2) = 0, 
and the appropriate polynomial to meet these conditions will be 

(9) Z = (c“ — x^) (tti + + ^8®* + ' • 0^ 

where c — Z/2. It is to be noted that (9) gives only the modes of vibration 
which are symmetric to the position of the y-axis. 

Taking only the first term of (9) as a first approximation for X, we have 


Then 


dx 


= — 2aia;. 


X — ai(c^ — x^), 

X.* (S) ’ X,” ^ > 

J* * X^dx = a." J* * (c* — + x*)dx = ^ Oi V. 


Substituting these in (8), we get 


d / 

dai \ 3 




3 


32kaiC^ 

15 


Hence k = ^ ^ . The exact value of Jc as previously found is 

k = ^ = . The agreement is thus fairly close. 

To get a better approximation, we take the first two terms of (9). 


Then 

X = (c^ — x^) (tti + a2X^), 

and 

— 2aiX + 2a2C^x — 4a2X^. 
dx 

Hence 

J., Wa:/ 3 +16 ‘ ^ + 105 ’ 

and 


f ® 2 , 16 2 5 1 32 7 , 16 2 0 


Substituting these in (8), taking the partial derivatives with respect to 
ai and a 2 in turn, and then reducing slightly, we get 


(1- 


2kc^ 

5 

2kc^ 

7 


)fflx +y (1 ^)a2 = 0. 

\ 1 c* /1-I . . 

)a, -j-— (ll — — y )fl2 — 0. 


(I 
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These tvo homogeneous equations will have a common non-trivial soln* 
tioD only if the determinant of their coefficients is zero, or 




5 

gjfcc* 


5 ^ 7 ^ 

7 ^ 3 ; 


from which we get 


— 2Sc^k + 63 = 0 . 

Solving this equation for h, we find 

, 25.63256 2.46744 

k= — 


= 0 , 


In the exact case we found 


Hence 
for n = 1, 

for n r= 3, 


poi^ , n^TT^ n^TT^ 

~T~ “ ■“ “4^ * 

1. — zl=: 9-8^9604 2.467401 

4c* 4c* ~ c* ^ 

^ 22.20661 
4c* ““ c* 


On comparing the above Kitz values of Ic with these exact values, we see 
that for the fundamental mode the Ritz value agrees with the exact value 
to five significant figures. 

Values of still greater accuracy can be found by taking the first three 
terms of the second parenthesis of (9) : 


Z = (c* — x*) (ui + azx* + a^x*). 


On evaluating s:m dx and X^dx, differentiating them with 
respect to Ui, a 2 , in turn, and substituting the results in (8), we get 
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These homogeneous equations will have a common^ non-trivial solution if 
and only if 


1 / 2kc^\ 

35 \ 9 ) 

Putting 2kc^ == A, expanding the determinant, and simplifying, we get 

A* — 225A* + 8910A — 38610 = 0, 

where all the coefficients are exact numbers (not rounded). 

The smallest root of the above cubic equation is easily found by the 
Newton-Raphson method, starting with the approximate value 4.93488 
(or preferably 4.935) found in the previous calculation. The new value 
is thus found to be 

Ai = 4.934802217, 
correct to the last digit given. 

The other two roots are best found by taking the root Ai out of the given 
equation, by synthetic division, and then solving the resulting quadratic 
equation. The depressed equation is 

A* — 220.065197783A + 7824.02177410 = 0, 

the roots of which (found by the quadratic formula) are 

As = 44.586811825, A, = 175.478385958. 

As a check on these values it may be noted that 



A, + A, + As = 225.000,000,000, 
as required by theory. 

We will now compare these Ritz values with the exact values. Since 


V I. A 2 ^ ^ 

A = 2kc^, k= y and w* = = 5 - 

X p It 

nV 


p 4c» ’ 


A = 


we find 
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Hence 


Ax 

A* 

A, 


ir* _ 9.869604401089 
2 ~ 2 

^ = 44.4132198, 


25 ^ 

2 


123.37. 


4.934802200545, 


It will be noted that the Ritz value for Ai is correct to eight significant 
figures, that the value for A 2 is hardly correct to two figures, and that the 
value of A», although of the proper order of magnitude, is so inaccuraic 
as to be almost worthless. 

The reader will observe that all the Ritz values are larger than the* 
corresponding exact values. This is usually the case. The reader should 
also note that more accurate Ritz values were found by taking additional 
terms in (9) and not by correcting previous values. As more terms of (9) 
are taken, the labor of computation increases enormously, so that more than 
three terms will involve an almost prohibitive amount of labor. 


112. Vibration of a Rectangular 

membrane of rectangular form with 

z 


Membrane. Consider a thin elastic 
sides a and b (Fig. 35), such as a 
very thin sheet of rubber, and 
assume that the membrane is 



made fast at the edges while 
tightly stretched. Take a set 
of three mutually perpendicu- 
lar axes, with the a;y-plane 
coinciding with the membrane 
and the ^-axis perpendicular to 
it. Then if an interior region 
of the membrane be pulled or 
pushed in a direction at right 
angles to its plane of equi- 
librium (the a;y-plane), it be- 
comes distorted into a curved 


Fio. 35 


surface^ the area of which is 
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approximately, since the distortion is small. The increase in area of the 
membrane due to the distortion is therefore 

=ix;x; [(!)■+ 

Let T denote the tension on a unit length of boundary of the membrane, 
the direction of T being perpendicular to the edge of the boundary. Then 
the work done in deflecting the membrane until its area is increased by 
an amount AjS is TA/S ; * and the potential energy in the deflected position 
is equal to the work done in producing the deflection. Since the deflection 
is small, the tension T remains practically constant. Hence the potential 
energy of the membrane in a deflected position is 

-•-•=fx;x;[(iy+(ir]^^- 

Because of the elasticity of the membrane, the deflection at any point is 
proportional to the force applied, and the motion is thus simple harmonic. 
Hence the deflection is a periodic function of the time, or 

z = Z{Xy y) sin cot. 


* Consider a rectangular region of dimensions u and v ( Fig. 36 ) . First let the 
side AB be fixed and let the membrane be pulled to the right with a force of T 

pounds per unit of width, or Tv for 
the whole side. The force Tv will 
stretch the membrane an amount 
Au and do Tv • Au units of work in 
doing so. 

Now let the side BO be fixed and 
let the membrane be pulled in the 
yy direction of the side AB by a force 
of T pounds per unit length of 
border, or T (u + Au) for the whole 
side. The force r(u + Au) will 
stretch the membrane by an amount 
Av in that direction and do 
T ( u 4- Au ) At? units of work in 
doing BO. 



Tv Au -|- T {u Au ) • At? =z T { i?Au -j- uAt? AuAt? ) 

= T times area of shaded border 
= T times increase in area of membrane. 




Abt. 112] 


THE RAYLEIGH-RITZ METHOD 


365 


On substituting this value of z in the above expression for the potential 
energy, we get 

= (tX' X’ [(§)’ + (f) ’] ■'*"**) 

The maximum value of this is 

(p. E.)„ = f /; /; [(!)■ + (!)■ ] ^ 

The kinetic energy of an element dm = pdy dx of the membrane is 

— j =\pdydx • Z*(a; cos^ wt, 

where p denotes the mass of unit area of the membrane. 

The kinetic energy of the entire vibrating membrane is therefore 

K, E. = (-^<1)*^ I I Z^dy dx) cos^cd^, 

and the maximum value of this is 


(K.E.Ux = ^r f'z^dydx. 

Since there is assumed to be no loss of energy due to vibration, the maxi- 
mum potential energy is equal to the maximum kinetic energy and we 
thus have 


(1) 

“2 


or 


(1) 


^x;x;-^-=fx;x*[(g)’+(i)’]^^-- 
._Tji£MhMn^. 


r Cz^dy 

%/ 0 %/ Q 


dx 


We must now assume for Z a linear combination of simple functions 
which will satisfy the boundary conditions of the problem. Such a func- 
tion is 


(2) Z = (d — x)(b — y){ai + azX + a^y + + o^xy + *•')• 

In order to make the convergence as rapid as possible, however, we move 
the origin to the center of the rectangle. Then because of symmetry we 
may write 



see 
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(3) z = (p* — X*) (g» — y*) (o^ + a,®* + a,y* + a^Y + •••)» 

where p = a/2, q = 6/2. 


Aesuming that Z in (1) has been replaced by (2) or (3) above, we 
must determine the a’s so as to make «>* a minimum. Hence the derivative 
of the right member of (1) with respect to each of the a’s must be zero. 
Then by the rule for differentiating a quotient we have 




Beplacing 




in the second term by its value 


_P 

T 



Z* dy dx 


as found from (1), we have 

/;r-»-7/;ri(iy+(iy}^’- 

- fr. £ ^ ■ IS. />■ 

fa fb 

Now taking out the common factor I I Z^dy dx, we get 


or 


^[rrKiy+dyh’--7x-»-]=»- 


where h = poi^/T and i = 1, 2, • • • n. Formula (4) will give n homo- 
geneous equations for determining n values of k. 

If the form (3) is used for Z, the limits of integration in (4) will be 
from — p to p for a; and — g to g for y. 

To get a first approximation to the vibration frequency of the membrane, 
we take only the first term of the parenthetic polynomial in (3). Then 
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Z = ai(p* — x^) (?* — y*) 

|^ = — 20ia:(g* — y') 

|^= — 2aay(p* — 1»). 

Hence 

= 4ai* r* ix’‘(q^ — y*)*+‘y*(P* — x‘')®}<iydx 

%/ -p -Q 

~ (if T ~ T(il) 


J'* Z=“ dy dx = Ai* J'*' J'* (P* — x’‘y(q^ — y^*)* dy dx — (^^PV®i*- 
On substituting these in (4), we get 

^il(if)“'W<*^ + «-‘(Tt)’“‘*'’'«' i ="■ 

or 

|- (p* + ?*) — j| 


from which 


k = 


5/ p^ + g^ \ 5/1 1\ 

2V pV / 2\p^^q^}- 


Replacing p by a/2 and q by 6/2, we get 


fc = 



Since k = po>’‘/T, we finally get 


Cl) 



The frequency is therefore 



This is the lowest or natural vibration frequency of the membrane. 

The vibration frequencies found by the classical method of separating 
the variables are given by the formula 
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For m = 1, 71 = 1 ^ this formula becomes 




Since V 10/27r = 0.5033, it is evident that the Eitz method gives a close 
approximation to the exact value. A more accurate value could be obtained 
by taking the first three terms of the parenthetical polynomial in (3), but 
the increased accuracy would be obtained at considerable expense in time 
and labor. 


113. Comments on the Three Methods. Three numerical methods for 
solving boundary-value problems in two dimensions have been considered 
in the present chapter. Each method has its advantages and disadvantages. 
The iteration method is slow, self-correcting, and well adapted to use with 
an automatic sequence-controlled calculating machine. The arithmetical 
operations are short and simple. 

The relaxation method is faster and more flexible than the iteration 
method. The arithmetical operations are simple, but mistakes are easy to 
make and are not self-correcting. It requires constant vigilance and alert- 
ness on the part of the computer. It is not adapted to use by an automatic 
calculating machine. 

The Eayleigh-Eitz method is of considerable value in liandling problems 
of equilibrium and elastic vibrations. It does not require a partial dif- 
ferential equation to start with, but it does require that a physical problem 
be reduced to the definite integral of a sum, difference, or quotient of two 
or more homogeneous positive and definite quadratic forms. The method 
furnishes a short and easy way of finding a good approximation to the 
natural vibration period of an elastic body, deflection of a membrane, etc. 
The chief disadvantage of the method is the laborious algebra involved in 
getting results of high accuracy. 

It is an easy matter to estimate the accuracy of results obtained by the 
iteration and relaxation methods, but this is not the case with the Ealeigh- 
Eitz method. No simple and useful formula for estimating the inherent 
error involved in this method has yet been devised. 

A choice between the iteration and relaxation methods would depend 
upon the mechanical aids at the disposal of the computer. If an automatic 
sequence-controlled calculator is at hand, the iteration method would be 
used. If an automatic calculator is not at hand, the relaxation will give 
the desired solution in the shortest time and with the least work. 
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Finally^ it must be realized that not all three methods may be applicable 
to a given problem. To use the iteration and relaxation methods, a physical 
problem must first be set up as a partial differential equation and this must 
then be converted to a partial' difference equation. The Rayleigh-Ritz 
method will give an approximate solution of a problem without setting up 
a partial differential equation, as was done in the cases of the vibrating 
string and vibrating membrane. In problems where all three methods are 
applicable, the Rayleigh-Ritz method would probably be the third choice. 

It is needless to say that all these methods are inferior to the classical 
method of separating the variables, but they will give approximate solu- 
tions to problems in which the variables cannot be separated. 



CHAPTER XIII 


THE NUMERICAL SOLUTION OF INTEGRAL EQUATIONS 

114. Integral Equations — Definitions. An integral equation is a func- 
tional equation in which the unknown function occurs under the integral 
sign as well as outside it. The simplest type imaginable arises from the 
integration of the simple differential equation dy/dx = f{x, y), with the 
initial condition y = yo when x = Xo. The result is 

y = I fi^,y)dx-\-C= r f(x,y)dx + yo, 
as stated on page 240. Two important types of integral equations are 

( 1 ) <i>{x) = y^K{x,t)<i>{i)dt 

and 

( 2 ) ^{x)^f{x)^ 

%/ a 

Here the functions E{x,t) and f{x) are known and <f>{x) is the unknown. 
K(x,t) is called the kernel or nucleus and is assumed to be a continuous 
function of x and t throughout the interval {a,b); that is, a^x^b, 
a^t^b. In physical problems the kernel is usually Greenes function. 

Equations (1) and (2) are called linear integral equations because the 
unknown function <t> occurs to the first degree. Also, (1) is called a homo- 
geneous equation and (2) is called a non-homogeneous equation. 

An integral equation of the form 

(3) >l>{x) =f{x) r K{x,t)F[t,<f,{t)'\dt 

%/ a 

is called a non-linear integral equation because the unknown function 4> 
does not occur in a linear fashion. 

To solve an integral equation of any type is to find the unknown func- 
tion 4>{x), In some cases this can be done by the method of iteration, 
by starting with an approximate value for c/>(a:), substituting it in the 
integrand, and performing the integration. The new value of <^(a;) is then 
substituted in the integrand as before and the process is repeated until 
no improvement is found in In general, however, the solution of 

integral equations by exact analytical methods is not easy. Hence it is 
necessary to fall back on approximate solutions by numerical methods. 

370 
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Several methods have been proposed for finding numerical solutions of 
integral equations. One of the simplest and most direct is the method 
suggested by Goursat ^ and later developed and extended in various direc- 
tions by Nystrom.^ The method explained in the following pages is a 
modification and amplification of -Nystrom^s method. The method consists 
essentially in replacing the unknown function under the integral sign by 
a polynomial of some form, integrating this polynomial over an interval, 
and then evaluating the integral at certain specified points within the 
interval of integration. 

Before proceeding to the numerical solution of integral equations, we 
make a short digression to indicate how integral equations can arise from 
simple problems, and particularly how the kernel gets into the equation. 

115. Boundary-Value Problems of Ordinary Differential Equations. 
Green’s Functions. In the elementary treatment of diiferential equations 
the function and all its derivatives are assumed to be continuous through- 
out the interval of integration. The general solution based on these 
assumptions is not as general as one might suppose. A few simple examples 
will suffice to show this fact. 

Example 1, Suppose a solution of the differential equation d^y/dx^ = 0 
is required such that y = 0 for x = 0 and x = 1, Proceeding by the usual 
method, we have 

^ = Cl, y = c^x + Cz. 

Substituting the conditions given above, we find Cz = 0 and Ci =: 0. Hence 
the solution is 

y = 0, 

the equation of a straight line through the points (0, 0) and (1, 0). 

This solution is trivial and is not the only solution which will satisfy 
the given equation and the given conditions. Since the solution must be 
of the form y := Ax B, the graph of which is a straight line, it is evident 
that a solution might consist of two linear functions whose graphs would 
pass through the respective end points and intersect at some point x = s, 
as shown in Fig. 37. We therefore attempt to find such a solution. 

Let the two linear functions be 

(1) yi = Ax 

^ Cours d* Analyse Mathematique, Tome III (3rd edition, 1923), pp. 368-369. 

* Aota Mathematioa, Vol. 64 (1930), pp. 185-204. 
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and 

( 2 ) y2 = C(l — x), 

which evidently satisfy the respective end conditions. A third condition is 
that = yz B,t X = s. Hence from (1) and (2) 

(3) As = C{l — s). 

A fourth condition becomes evident when we look at the graphs in Fig. 37. 


Y 



Fio. 37 


The slopes of the two lines are different at the point of intersection, or for 
X = s. Hence the first derivative of the required function is discontinuous 
a.t x = s, the amount of the discontinuity (difference of slopes) being any- 
thing we please but evidently depending on s. Call it 1c{s). Then 

Solving (3) and (4) simultaneously, we get 

A = (1 — s)k(s), C = sk{s), 

the arbitrary constants ” A and 0 thus depending on s. Substituting in 
(1) and (2) these values of A and C respectively, we get 

(5) yi = A;(s)(l— 5)a:, yz = A;(s)s(l — a;). 

In this and similar problems it is customary to put k{s) = 1. Hence 
the final solution is 

fy=(l — s)x for 0 ^ a; ^ 5 
1y = 5 (l — x) for 


( 6 ) 
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The reader will note that by discarding the usual assumption of con- 
tinuous derivatives in this example we have been able to find a worth-while 
solution which is everywhere continuous and satisfies the given boimdary 
conditions. On putting k{s) =0 in (5) we get the trivial solution first 
found. The solution (5) is thus more general than the usual general” 
solution. 

The solution (6) may be written as the single equation 

y = K(x,s), 

where 

K(Xy$)=:{l — s)x for 

s(l — x) for s ^ x ^ 1. 

The function K{s,x) is called Greenes Function for this example. It is 
a function of the two independent variables x and s in the interval (0, 1) 
and is evidently symmetrical in those variables. Greenes function in this 
case is thus the solution of the differential equation y"(x) =0, with the 
given boundary conditions. 

Example 2. Eequired the solution of 

(1) j/"(x) — = 0, 

with the boundary conditions y = 0 when x = 0 and x = 1. 

Solution, By the usual elementary method of solving such equations, 
we have 

= a^, or r = =h a. 

Hence the general solution is 

(2) y = 

= A cosh ox + sinh ax. 

Substituting in (2) the values y = 0, x = 0 and y = 0, x = 1, respectively, 
vre get 

0 = ^ 

0 = A cosh a B sinh a 

.'. B sinh a = 0, or B = 0 (since we, assume a=^0). 

Hence (2) becomes 

y = o, 

another trivial solution. 

To get a worth-while solution of this example we assume a function of 
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the form (2) for each end point of the interval rr = 0 to x = 1. However, 
since cosh 0 0, it is plain that the assumed functions need not contain 

cosh ax. Hence we take 

(3) yi = .4sinhax and y 2 = 5sinha(l — x), 

where we have now utilized the boundary conditions in writing down these 
functions. See Fig. 38. The graphs of these functions will evidently 


Y 



Fig. 38 


intersect at some point where x = s, and at that point the functions will 
be equal and their first derivatives will be unequal. Hence for x = 5 we 
have from (3), 

(4) A sinhflw = B8inha(l — s) 

(6) = Aa cosh as + Ba cosh a(l — s) 1, say. 

ax ax 

From (4), 

Bsinh a(l — s) 

““ sinh 05 

Substituting this value of A in (6), we find 

^ sinh as 

a sinh a 
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Hence from (6), 


^ sinh a(l — s) 

a sinh a 


Substituting in (3) these values of A and B, we get 

sinh fl(l — s) sinh ax 
a sinh a 

sinh as sinh a(l — x) 

a sinh a 

These can be written as a single solution in the form 


where 


yz=zK{s,x)y 


. 8inha(l — s) sinh ax . ^ 

K{s,x)= — r-r^ for 

' ^ a sinh a 


, sinh as sinh a ( 1 — x) 

K(s,x) — 

^ ' a sinh a 


for s < X < 1. 


The reader will notice that Greenes function takes care of the boundary 
conditions. 

The following example shows how a differential equation with boundary 
conditions can be transformed into an integral equation. 

Example 3, Solve the differential equation 

(1) g = 

subject to the conditions that y = 0 when x = a and y = 0 when x = b. 
Solution. From (1) we have 

jy{x)dx + C,=Jj f{s)ds + G^ 

and 

(2) y = /;(/; / (s)ds ^ dx -|- OiX -j- C 2 * 

At this point it is well to look at this double integral from a geometric 
standpoint. 

The double integral /; (/; f{s)ds^ dx may be looked upon as the 
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evaluation of the function f{s) over the region (area) ALP of Fig. 39, 
by first integrating over the vertical strip MN with respect to s and theji 
finding the limit of the sum of such strips by integrating with respect to x. 
Since x and s are both continuous throughout the region ALP, however, 
the double integral piay equally well be evaluated over this region by 


S 



Fig. 39 


integrating first over the horizontal strip RQ with respect to x and then 
finding the limit of the sum of these strips by integrating with respect to s. 


In this latter case the double integral would be /;(/; 
Hence we have 


f{s)dx I ds. 


s:{s: f(s)(is^ dx — s.u f(s)dx ^ ds 

— ~ — s)/(s)d4*. 


It is thus seen that the substitution of an equivalent integral for the given 
one enabled us to perform one integration and thereby reduce a double 
integral to a single integral. 

Now replacing the integral in (2) by the single integral given in (3), 
we have 
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(4) 


y = J* — s)f(s)ds-i-CiX + C2. 


To find Cl and C 2 we substitute in (4) the given boundary conditions 
x = a, y = 0 and x = b, y = 0 . Hence we have 

0 0 CiCL — |— C 2 

0 = j‘\b — s)f(s)ds + C 16 4- C 2 . 

Solving these equations for Ci and Cj, we get 


C, 


J] (b — s)f(s)ds 
h — a 


C2 = 



(6 — s)f{s)ds 


h — a • 


X r (6 — s)f{s)ds a C (b — s)f(s)ds 

%/ a I a 


Hence (4) now becomes 

(b) y = j\x-s)f{s)ds-. 

= (x — s)/(s)ds + (b — s)f{s)ds. 

For the purpose of this example we transform the second integral by the 
= 1 +1 Then we have 

0 0 X 


y(x) = {x — s)f{s)ds + I ^\b—s)i{s)ds 

or 

<«) »w=/; 

which may be written 

(7) y{x) = /; ir(x, s)f{s)ds, 

where 

g(a; 5 ) = for a^a ;<5 

^ ' b — a “ 

g(a;^ 5 ) = -- for s^x^b. 

Here, again, we note that K{x,s) is symmetrical in x and 8. 
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The final result (7) is a simple integral equation, and we have thus 
transformed a simple differential equation with boundary conditions into 
a simple integral equation. But we still have not found y, for in (7) 
y is expressed in terms of itself, the f{s) under the integral sign. 

It is instructive to check the correctness of (6) by differentiation. To 
do this we must use the formula for differentiating under the sign of 
integration. If 

• «a(a) 

i{x,a)dx, 


then 








dxi 


'*,(.) -'doe 

Applying this formula to (6) and treating x as a, we have 

b)(x — o) 




f(x) 


the second and fourth terms canceling each other, and 

X — b 


S=« + |Ef/w + o- 


b — a 




X d X -f- ^ \ ^ ® \ ' 

= — — /(X) 


which shows that (6) is correct. 


116. Linear Integral Equations. We shall first consider the linear 
equation 

(1) = fix) + t)<l,it)dt. 

Since a definite integral can be closely approximated by any one of several 
quadrature formulas (each of which was derived by integrating a poly- 
nomial over an interval), it is evident that the definite integral in (1) can 
be replaced by a quadrature formula, so that (1) may be written in the form 

(2) (f) (^x) = f {x) {b — (i)[CiK {x^ C 2 K ' ■ • 

+ CnE{x,tn)4>{tn)']y 

where U, < 2 , ' * • are subdivision points of the interval (a, b) and the 
C's are weighting coefficients whose values depend on the type of quadrature 
formula used. And since (2) must hold for all values of x in the interval 
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(a, 6), it must hold for a; = a; = ^ 2 >* * x = tn. Hence from (2) 
we get n equations of the type 

(3) =f{ti) + (b — a)[C^K{t^,t,)<|>{t,) +C2K(U,U)4>(t,) 

+ • ' + CnK{ti,tn)<l>{tn)], t = 1, 2, * * *71. 

For brevity let us put and f{ti) =fi- Then the system (3) 

becomes 

/i "h {b a)[CxK{tiy -f- C 2 K(^tiy ^2)^2 “h * ‘ * "f" 

(4) *^2 ~ /a 4“ ^ 1)^1 + C2K(t2, ^ 2)^2 4“ ' ■ ’ “H CnK(t2, ^n)^] 

, — /n 4" 4“ (' 2 ^i^ny ^ 2)^2 4” * ‘ * 4“ 

Equations (4) are a system of n linear equations in the n unknowns 
<f>iy <l> 2 y ’ ' ‘ <t>n and can be solved for these unknowns by the usual methods 
for solving systems of linear equations. After the <fy^s have been found, 
they are substituted in the right-hand member of equation (2). The 
result is the desired solution of the given equation (1), since (2) will then 
give <l>{x) for any value of x. 

The reader will note that in a quadrature formula the functional values 
<t>iy 4 > 2 ,' * * <t>n at the points of subdivision are given, whereas in integral 
equations these values must be found as part of the process of solving the 
equation. We get the equations for finding them by putting x = ti, ^ 2 , etc. 

Because of the difficulty of solving a large number of simultaneous linear 
equations, it is highly desirable that only a small number of functional 
values ((/>’s) be computed. In important problems the formulas of Gauss 
and Lobatto should therefore be used. 

Example 1. Solve the integral equation 

Kx 1 1 1 

9 + 3 Jo + 

Solution. In this simple example we evaluate the integral by Simpson^s 
Rule, taking n = 3 or ?i = Then 

(5) u(x) = -f— + x)u(h) 

+ (<a + s)u(<3)]. 

Since (5) must hold for all values of x from 0 to 1, it holds for 
* = <„ fj, Hence from (5) we get 
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ht 1 I 

W(^l) = ^ 18 + (^8 + ^l)^(^8)]^ 

K/ 1 1 

= V ~ 9 ■*■ li + 4(3<,M<,) + (<3 + <2)«(<,)], 

5/ 1 1 

«(< 3 ) = 9 +1^ + 2 <S«(< 3 )]. 

Now putting <1 = 0, <2 = ^, <3 = 1 and writing u(<i) = «i, we get 

Wi = — I + ^ [2w2 + U3] 

W2 = ^ + ^ [%«1 + 4 M 2 + %M 3 ] 

5 1 

t ^3 = - [1^1 + 6^2 + 2W3]. 

Clearing of fractions and transposing the w’s to the left side of the equa- 
tions, we have 

36^1 — 4^2 — 2t/3 == — 4 
— + 28^2 — 31X3 = 11 

— "Zui — 12^2 + 321^3 = 26 . 

On solving these equations by determinants (Cramer's Eule) or otherwise, 
we find u-i = 0, U2~\, ^3 = 1. Then substituting in ( 5 ) these values 
of the u's and putting ti = 0 , ^2 — 2, ^8 = 1, we get 


u(;e) = i+^[0 + 4(i+a:)(i) + (l+a;)(l)] =a:. 

This result can be checked by substituting it in the integrand of the 
original equation and performing the integration. Thus, putting u{t) =i, 
we have 



{t -\-x)tdt~- 



hx 1 , 1 , a; • 

6 9 "' 9'6 ^ 


Simpson's Eule gives the exact result in this example because the integrand 
is a second-degree polynomial in t. 

Example 2 . Solve the integral equation 

(6) u{x)= 2 x + \ r {x — t)u{t)dt 

o */ -2 

by Gauss's formula, using three points of subdivision. 



Abt. 116] 


LINEAR INTEGRAL EQUATIONS 


381 


Solution. We must first transform the equation so that the new limits 
of integration will be from — ^ to Hence we put 

t = a a; = c + dw. 


Substituting in the first of these equations the corresponding limits t= — 2^ 
V = — J and < = 3, v = we get a = b = 5. Hence the equation of 
transformation is 


Likewise, 


t = i+5v. 

a; = i 


Substituting in (6) these values of t and x, we have 

u(i 5w) = 1 lOw -i- f (w — v)u{i 5v)5dv. 

%/ -4 

Now put + 5t;) =<f^(v). Then 

<ft(w) = 1 + + 5 ^ (w — v)<l>{v)dv. 

Replacing the integral by Gauss’s formula, we have 


(7) <t,{w) = l + 10w 

-f- 5 [jBi {w — Vi)<t>{vi) R2 {w — V2)4>{'^2) H" — Vs)f^{v2)^. 

Now since (7) must hold for all values of w from — i to it must hold 
for w = Vi, w z=r. V 2 , w = V 3 . Hence on substituting in (7) these values 
for w we get the equations 

= 1 “h lOvi 5 [722(^1 — 1^2) <^(1^2) — ^s)^(v 8 )] 

<^(t;2) = 1 + lOVz + Vi)<l>{Vi) + R 2 {V 2 V8)<^(V3)] 

<^(^ 3 ) = 1 + lOva + 5[i2i(i;3 — Vi)4>{vi) + R2{v3 — V2)4>{v2)]. 

For the Gauss formula with three points of subdivision we have 

^* = 0. = = ^» = ^- 

On substituting these values in the equations above and writing <l>i for 
<^(vi) etc., we get 

♦. = 1 - vis + 6 [|(- i V|) * + ^( - V|) ♦.] 

♦■= * + ® [w(* 

♦. = 1 + vis + « [^ ( V|) ♦. + 1- ( W|) ♦. ] > 


( 8 ) 
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or 


( 9 ) 


^ O - e 

H” ^ Vl5 4>2 -h Vl5 ^5 = 1 — V 15 

"" ^ Vl5 <#>1 + <#»2 V16 <^a = 1 

i VTs <^1 + 1 V15 — 1 _ V16 . 


Solving these equations by determinants^ we find 


4>i = 
<f>2 = 


38 

37 


^(19 — 

37'^ 


9V15) 


9V15). 


As a partial check on the correctness of these results we notice that by 
adding the first and third of equations (8) and comparing the sum with 
the second equation we get = 2 <^ 2 , and this is true of the values 

found above. 

Now substituting in (7) these values of the <f>% and the numerical values 
of the R^b and v’s, we get 


( 10 ) 


= 


ISOw 

37 


37 * 


Since w = 


5 


, the final solution of (6) is 


^ ’ 37 5 


i) 


38 _ 36a; 
37 37 


^ — A. 

37 37 


(9a; — 14). 


This solution can be checked by substituting it in the original equation 
(6), as shown below: 

«(*) = 2x + — 0 ^ (9t—14)dt 

= 2® + f\9xt — 14x — 9t^.+ 14t)di 
185 -2 


2a; 


9a;^* 


— r 

185 L 2 


14a;^ — 3<® 




= 2z — 


38 ^ 

37 ^ 37 


36x 

87 


37 


= ^ (9* — 14). 
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117. Non-Linear Integral Equations and Boundary-Value Problems. 
Many boundary-value problems lead to non-linear integral equations of the 
type (3), Art. 114. The unknown function may be any func- 
tion of such as 8inx^(^), etc. In such problems the 

cannot be found by solving a system of simple linear equations as was done 
in the examples worked in Art. 116. It is possible, however, to find a 
system of equations which give the <l>^s in terms of the functions F^t, 

The can then be found by the process of iteration as was explained in 
Art. 74. 

Before proceeding with the solution of such non-linear integral equations 
we return to a further discussion of boundary- value problems. We con- 
sider first the second-order differential equation 

(1) y"(a:) = ^ = X4(a;)y + /(x), 

with the boundary conditions y = 0 when x = a and y = 0 when x = b. 
These conditions are usually written y{a) = y(6) =0. The functions 
A(x) and f(x) are assumed to be continuous in the interval (a, 6), and 
X is an arbitrary constant or parameter. 

Equation (1) can be reduced by direct integration^ to the integral 
equation 

(2) y(x)=xj‘ K(x,s)A{s)y{s)ds + K{x,s)f(s)ds, 
where 

K iXy s) — 

' ’ ^ b — a 

K{x,s )=— — ^ for x^s^hy 

but we shall here simply verify by differentiation that (2) is the solution 
of (1). Since K{XyS) has two different values, we write (2) in the 
equivalent and extended form 

^ M>)vMds + A £ 

+ j* + £ (x-.K.-i) 

_ [A^(s)y(s) + f(s)'ids 

+ J**" [AA(<)y(a) + /(s)]ds. 

* Lovett’s Linear Integral Equatione, p. 82; Goursst’s Coure d’ Analyse, III, p. 404. 
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No# applying the formula for differentiating under the sign, we have 

[A^(^)y(x) + fix)] 

+ X + f(s)]ds — — — — ^[A4(i)y(i) + f{x)], 

the integrated terms canceling each other, and 

y"(^) = 0 + + /(^)] + 0 - '^[\A(x)y(x) + f(x)] 

= [kA(x)y{x) + fix)] , 

or 

y"ix) =KAix)y{x) + /(x), 

which is Equation (1). 

Let us now consider a more general boundary problem defined by the 
differential equation 

(3) ^ = '4,"(x) =F[x,<f>{x)]-\-9{x), 

where F[x,<f>{x)'] represents any continuous function, g{x) is a given 
function, and the boundary conditions are <f>{a) =</>(&) =0. This dif- 
ferential equation with the given boundary conditions is equivalent to flu* 
integral equation 

(4) <t>(x) = f K{x,s)F[s,4>{s)]ds+ f K (x, s) g (s) ds, 

c/ a •''a 

where 

K{x,s)=- j ^ for a^s^x 

, (x -a)(s — b) . ^ ^ 

K(x,s)=- x^s^b. 


We shall verify this fact by direct differentiation of (4). 
Writing (4) in the equivalent form 
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= £ - ■ «) {x F[8, 4,{8)]ds 

+ J, b-a —T^9is)ds 

we differentiate the equation with respect to x, as in the preceding example. 
Thus 

«/•'(=') = X" + ^^~b-r‘^ ' 

+ £ ,i,(x)] + g(x)), 

the integrated terms canceling each other, and 

= 0 + fE^ <^(^)] + 9(x)) + 0 - ^ {F[X, <l>(x)] + g{x)) 

= (^t».*<.)i+«.))(|^-fE!) 

= {F[x, 4>{x)] + p(x)}^^) = F[x, ^(x)] + g(x), 

as was to be shown. We therefore solve the differential equation (3) by 
solving the equivalent integral equation (4). 

Since it is desirable to have a small number of equations for determining 
the and yet a high degree of accuracy is desirable, we restrict the 
function cases where F[a, </>(a)] =0 andF[6, <^(6)] =0. 

This restriction enables us to employ the subdivision points called for in 
Lobatto^s formula for five functional values, thus giving a high degree of 
accuracy and yet causing the two end values to drop out. We thus have 
only three interior points to consider and therefore only three equations 
for determining the <^’s. Although we can use the subdivision points 
required by Lobatto’s formula, we cannot use the quadrature formula itself, 
because that formula was derived by integrating a single function through- 
out the interval from a; = a to x = 6, whereas in the problem before us 
there are two different functions. We therefore replace the function 
F[Xy(f>(x)] over the interval (a, 6) by a fourth-degree poljTiomial given 
by Lagrange’s interpolation formula. 

To adapt the interval of integration as required for Lobatto’s points of 
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subdivision, we must change the limits of integration to — i and as 
was done in Ex. 2, Art. 116. We assume that the interval has thus been 
changed. The subdivision points for Lobatto’s formula are then Si = 0, 
82 = — i V3/7, S3 = i V3/7, S4 = — So = 


84 — — 82 — — V 3/7 Si — 0 S3 — V 3/7 S3 — 


Lagrange’s formula for F[s,<t>{s)~\ for these five functional values is 
therefore 

(5) F[s, 4 >(s)]=^ T-^lfVT ik 

(i Vf)(-Wf) 


(«) 




(s + i)(s-i) 




{s){s-^yll)(s+i)(s-i) I- 

the terms in F[ — — i)] and not being written because 

they are zero. When the terms in (5) are multiplied out, we get 

(6) 



Equation (6) gives F[ — — i)] =0 and = 0 as it should. 

The next step is to substitute (6) in (4) and then integrate over the 
intervals — ^ to a: and x to using the appropriate value of K{x^s) in 
each case. Thus, since a is now — \ and & is J we have 
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(7) ^(x) = r* + 

+ (a: + §)(s — i)^’[«,<#'(s)]<is + /(*), 

•/ w 


where f(x) stands for I K (x, s)g{$)ds and F[s, <l>{s)^ stands for the 

•/ 

right-hand member of (6). 

In carrying out the integration in (7), a: is treated as a constant; and 
although the integration is perfectly straightforward, it is long and tedious. 
The result is 


3 40^7 48 "^ 48^7 1920^7 “^ 1280 / 


X* 


J 5 - 

I . 

48 

48 ^ 


^1920 


4 


L+-L.) 

7 1280 / 


+ /(^)- 


This formula (8) gives the complete solution of the integral equation 
(4), or the differential equation (3), for any function Flx,<f>{x)'\ as soon 
as 4>i, <l> 2 , <^8 are known. 

To find these </)’s, we evaluate (8) for x = 0, x = — and 

I 

X = J-^|-. Denoting <l>{xi) by <^„ /(xi) by /„ etc., and doing some 
tedious arithmetic, we get 


( 9 ) 


' _ A ^.( 0 , ♦,) _ r(- i Vf- . « f (1 Vf , ♦.) + /. 

^ -5i5 ^ 


or, with decimal coefficients, 
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— 0.075000000 ^(0, ^,) — 0.025520833 F{— i 4^) 

— 0.025520833 Vf > •Aa) + /x 


( 10 ) 


= — 0.032653061 F{0, <)>,) — 0.030952381 F{— i 
— 0.007142857 F{i >/f > <l») + U 

<^, = —0.032653061 i!’(0, <^0 — 0 007142857 ^’(— i Vf-J <#>») 
= — 0.030952381 ^’(i Vf-.-Aa) + /a- 


Since f{x) can be easily found in any given problem, the can be 
found from (9) or (10) by the process of iteration if approximate values 
are known at the start. Then the desired solution of (4) is found by 
substituting the </>’s in (8). 

The reader should observe that in the special case where F\x^4>{x)'\ 
= 4^ (a;), equations (9) and (10) will give the (f>B in a system of linear 
equations as in Art. 116. A difEerential equation of the form 

<^"(ar)=r<^(a:)+/(^), 

with 4>{a) = ^{h) == 0, can thus be solved by means of (9) or (10). 
Example. Solve the differential equation 

( 11 ) = sin tt>(x) — 1 , 

with the boundary conditions <^( — J) = 0. 

Solution. Here F[a:, <^(a;)] = 8in<^(a:) and ^(ic) = — 1. Since<^(±:i) 
= 0, sin <l>{±: i) =0 and we may therefore utilize equations (9) or (10). 

To get approximate values for we assume that the solution of (11) is 
not very different from the solution of the similar equation 

(12) <^"(a:) =<^(a;)-l, 


or 


(13) — 

Solving this by the usual elementary method, we have 
r* — 1=0 or r=dtl. 
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Hence the complementary function is 

ipc = A cosh X B sinh x. 

To find a particular integral we assume = C. Hence = 0. 
Substituting these in (13)^ we get 

— C = — 1 or (7 = 1. 

Hence the general solution of (12) is 

(14) <f> = A cosh X B sinh x 1. 

Now substituting in (14) the given boundary conditions <^(±i)=0, 
we have 

0 = A cosh i — B sinh ^ + 1 
0 = -4 cosh i B sinh i + 
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Hence 


Since F[Xy 4>{x)‘\ =sin<^(cc), equations (9) become 


(16) 


sin <f>x — 
~ ~ 490 


49 


sin <^2 ■ 


49 


1920 


sin <^3 + A 


1920 

13 - ^ 1 • ^ ^ 


^ _ 16 • 1 
**““490 *'“140 


sin 4>2 


13 


420 


sin <^a + A • 


We now substitute in the right-hand member of the first equation of (16) 
the numerical value of /i and the approximate values of </>i, <#> 2 , <#»8 found 
above. Then we have 


3 49 

= — ^ sin(0.11318) — ^ sin(0.065247) 
49 

sin (0.065247) + 0.125000 

1920 ^ ^ 

~ _ 0.0084704 — 0.0033279 + 0.1250000 
= 0.11320. 


Now substituting this value in the second equation of (16), we get 

sin (0.11320) — sin (0.065247) 

— sin (0.065247) + 0.07142857 

= — 0.0036884 — 0.0020181 — 0.0004657 + 0.07142867 
= 0.066256. 

Also, 


^•(*> = 0 . 065266 . 
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We now repeat the above process by substituting in 

the right-hand member of the first of equations (16). Then 

3 40 

— ^sm(0.11320)— — sin(0.065256) 

49 

“" 1920 + 0.125000 

= — 0.0084719 — 0.0033284 + 0.1250000 
=r 0.11320. 


Now substituting this value in the second of equations (16), we have 

^ sin (0.11320) — sin (0.065256) 

— ~ sin (0.065256) + 0.07142857, 
or 

= — 0.0036884 — 0.0020184 — 0.0004658 + 0.07142857 
= 0.065256; 

and 

_ 0.065256. 


Since those values of the <^’s are the same as the preceding set of values, 
we take them to be correct. 

The required solution of equation (11) is now obtained by substituting 

1 37 ^ 

in (8) the values of <f> and f(x) found above. Thus, since f{x) = — — — 

o 2 

and F[0,<#„], are to be replaced by 

sin <^i, sin <(> 2 , and sin <^3, respectively, we have 


or 


* (X) = (o.„ 2958) (^ - g - J^) 

-f <»•“=*'>»> (w -i+svf - +i^) 

- f -S - SVf + iijVf + 



(17) <f,{x) = 0.11320 — 0.44352** — 0.03675** — 0.001443**. 
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Ab a partial check on this result ve find by substituting x = } and 

x — ^ in (17) that (/>(± i) = 0 , as it should be. To check the result 
completely, it is necessary to go back to equation ( 6 ) and replace F{0, ^i), 

and by sin <^ 2 ^ and sin <^ 3 , respec- 

tively. The result is then substituted in equation (4). The integration 
is then carried out over the intervals — ^ to cr and x to the appropriate 
value of K{x,s) being used in each case. Note that the second integral 

1 x^ 

in (4) is f{x) = - — — , which has already been found. This complete 
8 2 

check has been carried out for this problem, the right-hand member of 
(4) giving the right-hand member of (17) above. 



CHAPTER XIV 


THE NORMAL LAW OF ERROR AND THE 
PRINCIPLE OF LEAST SQUARES 

118, Errors of Obseryation and Measurement. All measurements are 
subject to three kinds of errors: constant or systematic errors, mistakes, 
and accidental errors. Systematic errors are those which affect all measure- 
ments alike. They are mostly due to imperfections in the construction 
or adjustment of instruments, the ^‘personal equation of the observer, 
etc. Such errors are usually determinate and can be remedied by applying 
the proper corrections. 

Mistakes or blunders are large errors due to careless reading of measuring 
instruments or faulty recording of the readings. They consist mostly in 
reading the wrong scale, reading a vernier backward, making a miscount 
in observations which involve counting, putting down the wrong number 
when recording the readings, etc. Mistakes do not follow any law and 
can be avoided or remedied only by constant vigilance and careful checking 
on the part of the observer. 

Accidental errors are those whose causes are unknown and indeterminate. 
They are usually small, and they follow the laws of chance. The mathe- 
matical theory of errors deals with accidental errors only. 

119. The Law of Accidental Errors. In order to get a better under- 
standing of the behavior of accidental errors the reader should try the 
following experiment: 

Take a sheet of ruled paper and draw with pen or pencil a line bisecting 
the space between two rulings near the middle of the sheet, as shown in 
Fig. 40. Lay the sheet flat on a table or floor, with the rulings upward. 
Now take a sharp-pointed pencil, hold it lightly by the top between the 
finger tips of both hands, and about two feet above the paper. Take good 
aim at the line on the paper and try to hit it by dropping the pencil on it. 
Drop the pencil in this way at least 100 times, making an honest effort to 
hit the line every time. The shots will be self-recorded as dots on the 
paper. Count the dots in the compartment (space between the rulings) 
containing the target line, and the number in each of the other com- 
partments on each side of the central one. Plot a curve by using as 
abscissas the distances from the target line to the midpoints of the 
several compartments containing dots, and as ordinates the number of dots 
in the corresponding compartments. 
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Ah experiment of this kind gave the results recorded in the table below. 
These results are plotted in Fig. 41 . 



1 I I I I I I I I r 


-5 -4 -3 -2 -I 0 1 2 3 4 5 

Fio. 40 


Compartment 

No. of dots 

3 

1 

2 

6 

1 

31 

0 

53 

-1 

32 

-2 

6 

-3 1 



1 


Total 


130 
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If the pencil had been dropped 10,000 or more times instead of 130 
and the width of the compartments correspondingly decreased, the plotted 
points would have followed the curve shown in Fig. 41. This curve is 
known as the Normal Prohabiliiy Curve. Its equation will be derived in 
Art. 121. 

All kinds of accidental errors follow the same law as the pencil shots 
in this experiment. 

120. The Probability of Errors Lying between Given Limits. In 

many applications of the theory of .probability it is necessary to find the 
chance that a given error will lie within certain specified limits. In such 
cases we utilize the fact that the probability that an error lies within given 
limits is equal to the area under the probability curve between those limits. 
The following proof, while not altogether rigorous, is sufficient to show 
the truth of this statement. 

Going back for a moment to the target experiment of Art. 119, we recall 
that in plotting the results we erected ordinates at equal distances apart 
along the a;-axis. The height of each ordinate was made proportional to 
the number of dots falling within the corresponding interval on the target. 
If we imagine rectangles constructed with the equal intervals along the 
x-axis as bases and the corresponding ordinates as altitudes (see Fig. 42), 


Y 
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we readily see that the area of each rectangle is proportional to the number 
of dots falling within the corresponding compartment. Thus, if Ni is the 
number of dots in any compartment and Ai is the area of the corresponding 
rectangle, we have 

(1) Ai = k,Ni. 

Now if we make one more attempt to hit the target line in the experi- 
ment of Art. 119, the chance of hitting within the central compartment 
is about 53/130, .that of hitting within the next compartment to the right 
is about 31/130, etc. The chance of hitting within some one of these 
compartments is therefore 

— 6 , 1 , 32 6 , 1 _ 130 _ 

130 130 + 130 130 + 130 130 130 “ 130 “ ‘ 

Since the chance of hitting within any compartment is proportional to 
the number of hits made in a large number of shots, we have for any 
compartment 

( 2 ) = 

where pi is the probability that a single additional shot will fall in any 
compartment in which Ni shots fell in a previouc experiment. Eliminating 
Ni between equations (1) and (2), we get 

(3) 

which shows that the chance of making a hit in any compartment is 
proportional to the area of the corresponding rectangle. The chance of 
hitting within some compartment is therefore 

(4) p = l=p, + p, + • =1^ (yl, -)-.4, + • ■ ■) 

Now when the number of shots is increased indefinitely and the width 
of each compartment on the target is correspondingly decreased, it is 
plain that the bases of the corresponding rectangles will likewise decrease 
and that the sum of the areas of these rectangles will approach the area 
under the probability curve as a limit. The area under this curve is 
always finite, and since it represepts the probability that a shot will fall 
somewhere y it (the area) represents certainty and therefore may be taken 
as 1 ; or lim 2^ = E Hence by (4) we have 

1=^(1), or k, = k,. 
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Equation (3) now becomes 

(5) Pi = A„ 


which shows that the chance of making a hit in any compartment is equal 
to the area of the corresponding rectangle. 

From equation (5) we have the important result that the chance of 
making an error whose magnitude lies between x and a; + Aa; is ♦ 

( 6 ) p = y^x, 

where y is the ordinate to the probability curve. The chance of making 
an error whose magnitude is between x^ and Xz is therefore 


(7) 


p = lim 2 = I yd^ 

Aw-*o J 


121. The Probability Equation. To derive the equation of the Proba- 
bility Curve we make use of the following facts as to the distribution of 
accidental errors^ as indicated by the table of Art. 119 and the corre- 
sponding curve: 


1. Small errors are more frequent than large ones, which shows that the 
probability of an error depends upon its size. 

2. Positive and negative errors of the same size are about equal in 
number, thus making the probability curve symmetrical about the y-axis. 

3. Very large accidental errors do not occur. 

These three fundamental facts are so self-evident that they may be taken 
as axioms. 

From axioms 1 and 2 it is plain that the ordinate to the probability 
curve must be a function of the square of the abscissa, or 


Here the function is called the error function. Our problem now 

is to determine the form of this function. 

Referring once more to the target experiment, we can readily see that 
if we had aimed at a particular point on the target line the distribution 
of shots with respect to the line would not have been different from that 
found in this experiment. Suppose, then, that we try another experiment 
of this kind and aim at some point 0 in the plane of the paper. The 
shots will be distributed about O in such a manner that if we draw any 


Except for differentials of higher order. 
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line through 0 the probability that any shot hits at a distance c from 
this line will be 

p = fi^)de. 

Let us therefore draw through 0 any two lines at right angles to each 
other. We shall take these as axes of coordinates for two variables x and y. 
Let us consider any shot that falls at a point P{x,y). The chance that 
P lies in a strip of width dx at distance x from the y-axis is 

P, = fix^)dx; 

and the chance that P lies in a strip of width dy at a distance y from 
the x-axis is 

Pv = f{y*)dy. 

The chance that P lies in hotJi of these strips and hence in the small 
rectangle dxdy is therefore 

(1) p = p^py = f(x^)f(y^)dxdy. 

If we draw any other set of rectangular axes through 0, so that the 
coordinates of P referred to these axes are x' and y\ we evidently have 

P»' = fix'^)dx', 

py = f{y'^)dy'. 

Hence the chance that P lies in the rectangle dx'dy' is 

(2) p' = fix'^)f{y'^)dx'dy'. 

But the chance that this particular shot falls within a small area A 
is the same regardless of the orientation of the axes through 0. Hence 
if we take dx^ and dy' such that 

dx'dy' = dxdy = A, 

we have 

P = f(x^)f(y^)A=f(xVf(y'nA, 

or 

(3) /(x*)/(y*) 

Suppose now that the axes OJST' and OY' are oriented so that OJC' 
passes through P. Then 

it'=V** + y*, ^ = 0. 

Hence (3) becomes 
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(4) f(x^)f(yn = + y^)/(0) = Cf{x^ + 

since /(O) is a constant. 

Equation (4) is a functional equation and can be solved by first 
differentiating and then integrating. 

Differentiating (4) partially with respect to and y- in turn, we have 


4n^i2\4(^2\ — r .'k-y. ) 


r{y-)f{x-)=C 




Now since df{U'\- v)/du — df{u-\- v)/dv, the right-hand members of these 
equations are equal. Hence 


or 


r(x-)f(y^)=ny^)f(^^). 


__ fif') 
f{y^) 


= k, say. 


Multiplying the equation = k through by d{x^) and inte- 

grating with respect to x^, we have 

loge /(^") = 4 - loge c, 

or 


( 6 ) 


f{x^) = 


Now since the probability of an error decreases as the size of the error 
increases, it is plain that k must be negative. Putting k = — we have 


(6) f{x^)=ce-^^< 

Hence 

(7) y =z 


is the equation of the probability curve. 

To determine the constant c we utilize the fac^t that the area under the 
probability curve is equal to 1. Hence we have 

( 8 ) 1 = ^ ce~^*^dx = ^ e~^^'^*d{hx) . 

This integral must be evaluated by an indirect method. To effect the 
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evaluation let us consider the volume of the solid of revolution (Fig. 43) 
included between the ary-plane and the surface generated by revolving the 
curve z = about the 2 -axis. Since this is a surface of revolution, its 
equation is 

(9) 2 

In cylindrical coordinates this equation becomes 

(10) z — where a;^ -f- = r^. 



Taking as the element of volume a cylindrical shell of radius r, thick- 
ness dr, and height z, we have 

dV = %irr ' dr ' z — ^irrer^^'dr. 


( 11 ) 


= 27r f e~^'rdr =z — ^ \ e~^^{ — 2rdr) = — 7r(e"*’“| =7r. 

O 0 —Jo 


Using rectangular cordinates, we take as the element of volume a prism 
of base dxdy and altitude z. Hence we have from (9) 
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( 12 ) 


= 4 f zdxdy = 4 f “ r 

= 4 f'e-^dx C'°e-<^dy. 

0 0 




Now since the value of a definite integral depends only on its limits 
and not on the variable of integration, we may replace y by a; in the 
second integral. We then have 

( 13 ) ^ = 2 ' 

Since we have already found V — ir above, we have 


(14) 


^ =iT, or 


Substituting this in (8), we get c = h/y/ir. Now putting this value of 
c in (7), we have finally 

h 


( 121 . 1 ) 






as the equation of the probability curve. 

Equation (121. 1) is of fundamental importance 'y for it is the foundation 
of the Theory of Errors, the Principle of Least Squares, and the Precision 
of Measurements. It is known as the Probability Equation, Error Equation, 
etc. ; and its graph is known as the Normal Probability Curve, the Error 
Curve, Gaussian Curve, etc. 

It will be observed that this important equation contains only one 
arbitrary constant. This constant h is called the “ index of precision.’* 
To see the reason for this name we notice that the larger h is the higher 
the probability curve will rise in the middle and the more rapidly it will 
fall on each side of the hump.” This fact, when considered in connection 
with the target problem, means that a large percentage of the shots hit 
near the target and very few hit far from it. In other words, it means 
accurate shooting. 


122. The Law of Error of a Linear Function of Independent Quantities. 

We shall next prove a fundamental theorem of great importance, namely : 

If Ml, 3 / 2 , ' ' Mn are independent observed quantities whose laws of 

error are 


y — 






'y = 


hn_ 

yJiT 




then any linear function of these quantities obeys a similar law of error. 
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Proof: Let the linear function be 

(1) F = aiMi + a2M2 + ‘ • OnMn, 

where ai, a2, * * • a» are arbitrary constants. If Xi, ajj, • • Xn denote the 
errors of M2,' * * M^y respectively, and i denote the corresponding 

error in Fy we have 

-P + f {Mx + Xi) <^2 (-^2 “h ^2) -j- • • * + an( 3 fn + aJn) 

~ Q>iMx OiXi ^ 2-^/2 0’2^2 “h ' ’ "1“ O^M^ -|- dn^n • 

Subtracting ( 1 ), 

(2) ^ diXx -f- (12^2 * ‘ dnXf^ . 

The error ^ in F is thus a linear function of the errors in 3 fi, M2y etc. 
We are now to show that the law of error for ^ is the same as the laws 
for Xi, X2, etc. 

To simplify the proof we first take a linear function of two independent 


quantities. 

F = dyMy + UzJfa 

Then 


C3) 

( = UiXi -(- ^2^2 • 

Hence 



^ = ai(x, + Axi) +a 2 (x 2 + AX2). 

An error of magnitude Xi to Xi + Axi in My combined with an error of 
magnitude X2 to X2 + AX2 in Jlf2 will therefore produce an error of magni- 
tude ^ to ^ 4 - ill P- 

The probability of the occurrence of an error lying between Xy and 
Xy + AXi in My is 

Pi = 4= , 

VV 

and similarly the chance of an error lying between Xa and Xa Axg in Afa is 

P2 = 4= e-*>‘'***Ax 2 . 

Vir 

The probability that these two independent errors will occur simultaneously 
and thereby cause an error lying between ^ and $ in F is therefore 

the product of their separate probabilities, or 

P = pipa = e"^“^*“^***AXiAXt . 

TT 


( 4 ) 
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This is the probability that any single error in combined with any 
single error in M 2 will produce a single error in F. But equation (3) 
shows that an error in F may be produced by combining any value of Xz 
(that is, any error in Mz) with all possible values of Xi from — 00 to 
+ <x > . Hence the total probability of an error between ( and ^ is 

the sum of these mutually exclusive events, or 

( 6 ) ^^2 f e‘'‘i**i*“^*****da:i , 

TT %/ _ go 


where denotes the error function for f. 

Let us now consider a single definite error i in F. This means that 
£ in (3) is to be considered constant for 'the time being. Hence from 
(3) we have 


Xz 


£ — 
(hz 


Substituting this value of 2:2 in (5), we get 


(6) = — Aij f . 


To simplify the integration, we transform and simplify the exponent 
of e as follows: 

For convenience we write 



Now expand the squared term and reduce the whole right-hand member 
to a common denominator. The result is 


— ao^Xi^hi^ — 4 ~ ^a^Xihz^i — a^^x^^h2^ 

or 

az^ a2* 

Now multiply numerator and denominator of the first fraction on the 
right by We then have 

h.^e(a^^hz^ + az^hr) (a^^hz^ + az^h,^')xr 2a.x^z^( 

^ — ~ az^ia^^hz^ + az^h,^) az^ ^ 


which can be written in the form 
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(ai^/i2" + 

a2*(fli*/i2* + a2*/ii*) (12 

2aiXiih2 ^ 

‘ 02 ^ a2^{ai^h2^ + CL2^hi^) * 

or 

_aifV+_a^ 
ax^h2^ H- (h^hi^ a.f 

2 , ai^h2*$^ 

^ V ‘ ■*" 

/ OiV|__y 

01*^2* + a2®Ai* <12“ 01*^2* + 02*^1“ / 

We now simplify this by putting C7* = + <» 2 *fei*. Then 

„ _ c^ ( a,h,^i Y 

0 * V^' C^ ) ■ 

The integrand in (6) now becomes 

which can be written in the form 


Since the first factor is independent of Xi, it may be removed from under 
the integral sign. Then (6) becomes 


,^(i) AI 2 • r . 

TT m/ —to 


Now put 



) 


Then du= {C/a 2 )dxi, or dx^zzz {a 2 /C)dUy since ( is constant. Hence 


But 


by Art. 121. 

(7) 


4,(i)Ai = ^ • — f V^’du . 

TT (y — to 


e-“’du = 2 • = Vir , 

/O 


We have now taken account of the effect of the errors Xi in Mi in causing 
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a particular error i in F, so that $ is now a function of X 2 alone. Hence 
from (3), regarding Xj as a constant, we get Af — a 2 Ax 2 . Substituting 
this value for in (7) and replacing C by its value '\/ai^h 2 ^ + az^hi^, 
we get 


( 8 ) 

or 

(9) 

where 

( 10 ) 




OLl^h 2^ “I” 


V-n- 


e-Wh^/ 








hi^h2^ 


+ Uj'/ir ’ 

The law of error for the error in F, is thus of the same form as the 
laws of error for Xi and Xj, the errors in Mi and Mg. 

From (10) we have 


(11) 


1 


4- dz^hi^ ai^ . 


h^^h2^ 


To extend this relation to a linear function of ahy number of inde- 
pendent quantities, take 

F a^M-i 4“ 0/2^2 4” ^3^8 (ttiilfi -|- (I 2 M 2 ) 4” • 

If hs denote the precision index of the errors in Jlfg, and Hz the precision 
index for F, then by (11) 

_ ' _ ai^ 1 d2^ . dz^ 

H? ■“ Hi* + ft,* “ fti* ft,* 

In the same way, we can extend the formula to a linear function of 
4, 5, or any number of quantities. We therefore arrive at the following 
result : 

7/ F 6e a linear function of n independent quantities which have been 
determined by observation, the function F follows an error law which is of 
the same form as the error laws of the independent unknowns. If the 
function is 

F “ a\M.\ 4” d2^2 4“ d^M-z ' ' 4” dfiM-ti > 


the index of precision, H, of F is given by 
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Even when F is not a linear function of the independent quantities 
Mu M 2 y * • • Mny the error ^ in F will follow the Normal Law approxi- 
mately if the errors Xu ^ 2 , ■ ■ Xn are relatively small. For let 

(12) F = f{MuMu- • Jlfn) 

represent any function of Mu M 2 , etc. Then errors in the M^s will cause 
an error in F according to the relation 

F + i = f(Mi + XuM2 + X2,‘ • Mn + Xn). 


Expanding the right-hand member by Taylor^s theorem, as in Art. 6, 
we have 

(13) f + £ = /(».,«.. . + + . + 

-f- terms in Xi^, XiXz, etc. 


Now if Xu X 2 , etc. are so small that their squares, products, and higher 
powers may be neglected, we have after subtracting (12) from (13) 


(14) 


^ ~ (W, dM, ' 


dF 


which is a linear function of Xu Xz, etc. Hence by (122. 1) we have 


(122.2) ^ = 


/DFV / ZF y / dF \ 

AdMj . , V93/J 

7 9 ’ 7 0 1 ] 7 O 


hi^ ' ^ 2 ® ' ' hn^ 

where H denotes the index of precision for the errors 


123. The Probability Integral and Its Evaluation, To find the proba- 
bility that an error of a given series will lie between the limits Xi and 
X 2 we merely find the area under the probability curve from x — Xi to 
X = X 2 , as shown in Art. 120. This means that we must evaluate the 
integral 

The integral 

I = h rV*’*’dT= r%-"*'>*£i(Aa:) 

0 ^ 0 

can not be evaluated in finite form, but we can expand the integrand 
into a power series and then integrate as many terms as we need. Since 
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we have 

Hence 

( 2 ) 


«' = i + - + fr+fr+-+ff+ 


2! 3! ^4! 




5X2! 7X3!"^ 9X4 1* 


This series converges rapidly for small values of t, and the error com- 
mitted by stopping at any term is less than the first term omitted 
(Art. 12). For example, it t = ^ we have 


Jo 2 24 ^320 5376 ^1105 


Jo 2 24 ' 320 5376 ' 110592 

= 0.5 — 0.04167 + 0.00313 — 0.00019 -f 0.00001 
= 0.46128. 

This result is correct to the last figure, since the error is less than 

— rH = 0.00000037. 

11X51^ 2703360 

For large values of t the series (2) is not convenient for purposes 
of computation, because too many terms are needed to give the desired 
degree of accuracy. We shall therefore derive an expansion in descending 
powers of t, which may be used when t is large. 


Since 

^ jO 

r * 

P 00 


1 e-^dt = 

1 e-^'dt + 



Jo ^ 

* 0 .. 

/f 

we have 




(3) 



r* oo 

J t-m . 


The value of the first integral on the right-hand side haa already been 
found to be '\/ir/2. Hence (3) becomes 




The remaining integral on the right-hand side can be written in the form 
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Integrating this last expression by parts, by putting u = l/t, dv = 
we get 


or 




dt 


1 ^ 
2 t 


+ 


1 r 1 

ij, p '-<*"«) 




r ‘ _ 1 1 e-‘‘ , 3 f “ e-** ,, 

J, " '^'-2 ~T~4 “F+4 J, 


By continuing this process of integrating by parts and substituting 
limits, we get the following expansion : 


( 5 ) 



«:!Vi ^L+i_J._liLl 

2t \ 2<= ^ (2<2)- (2P)" 


Substituting this in (4), we get 


)■ 


( 6 ) 





11-3 1-3-5 

2t- (2py {2l-y 


This series (6) is called an asymptotic series. It is divergent, but the 
terms in parenthesis decrease in numerical value so long as the number 
of terms does not exceed t^ This is the maximum number of terms 

ever used in computations with this series. The error committed in using 
(6) is less than the last term retained.* 

As an example of the use of (6) we shall compute 


We have 


X 


e~*^dt. 


8 ^ 64 512 ^ / 

= 0.8862 — 0.004579 ( 1 — 0.125 + 0.046875 — 0.029297) 
= 0.8862 — 0.0041 = 0.8821. 


See Chauvent’s Spherical and Practical Astronomy, Vol. I, p. 156. 
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The error committed is less than 

0.004579 X 0.029297 = 0.00013. 

As a matter of fact, the number 0.8821 is correct to its last figure. 

By means of formulas (2) and (6) one could compute a table giving 
the value of the probability integral for any value of t. Such tables were 
computed long ago, and a table of this kind is given at the end of this 
book. This table gives the probability of an error lying between — t and 
“I- t, where t = hx. Since the probability curve is symmetrical with 
respect to the y-axis, the chance that an error lies between — t and -j- t 
is twice the chance that it lies between 0 and -1- t. Hence the probability 
of such an error is 



where t hx. The use of the table will be explained in working the 
examples in the next article. 


Y 



X 


I 

I 


Fio. 44 

124. The Probability of Hitting a Target. Suppose we take a rect- 
angular target and draw through its geometric center two lines at right 
angles to each other and parallel to the sides of the target, as indicated 
in Fig. 44. Suppose, further, that we set up this target in a vertical 
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plane at a convenient distance away and shoot at it 100 times with a good 
rifle. If the rifle is accurately aimed at the intersection of the dotted 
lines, the hits will be distributed symmetrically above and below the 
horizontal dotted line and to the right and left of the vertical dotted 
line, just as in the case of the pencil hits described in Art. 119. 

If we take the horizontal line as a:-axis, the vertical line as y-axis, and 
a line through the intersection of these and perpendicular to the plane 
of the target as 2-axis, the hits will be distributed on each side of the 
vertical line according to the formula 

( 1 ) ^ = 

Vir 

and they will be distributed above and below the horizontal line according 
to the equation 

(2) 2 = -^e-»*V. 

\/ TT 


The indices of precision hx and hy in the two directions may or may not 
be equal. 

Before we can apply formulas (1) and (2) to problems in target 
practice we must know the values of hx and hy for the particular gun at 
the given range. The precision of a gun is indicated by its probable 
error or its mean error (see Art. 133), and these are determined from 
firings at the proving grounds. 

If r and 17 denote the probable error and the mean error, respectively, 
we have (see Art. 133) 


Hence 

( 3 ) 


h = 


0.4769 

r 


0.5642 

V 


^ 0.4769X 

hx = 

r 


0.56423: 

V 


Note. When using the probability table for the solution of target 
problems the student must keep in mind the fact that the argument for 
this table is hx, where x is the given or allowable error; but since 
hx = 0.47693;/r = 0.56^2x/rj, it is evident that the proper argument for 
entering the table is 


(a) 


0.47693: 

r 


when the 'probable error of the gun is given, and 
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,, , 0.5642a; 

(b) 

when the mean error of the gun is given. 

Example 1, For a certain 3-inch gun at a range of 4000 yards the 
probable errors were r^g = 10.4 yards and Vy = 5.8 yards. Find the prob- 
ability of hitting at the first shot a rectangular target 18 ft. high and 
30 ft. long. 

Solution. The probability that the shot will land in a vertical strip 
10 yds. wide is 

p —-h:-. = -?= ; 

and the probability that the same shot will land in a horizontal strip 
6 yds. wide is 

P _ r C 

The chance that the shot will land in both of these strips and therefore 
hit the target is 

P = P^Py = r X -7=- r e-(''<^’‘d{hyy). 

* V7r*'o 

But 

, 0.4769a: 0.4769 X 5 

M 

by (3), and 

^^^^0^^0,47^^0.247. 

Ty 0.0 

Entering the probability table with these values of hx as arguments, 
we find 

rr 0.254, Py = 0.273. 

Hence 

P z= P^Py = 0.254 X 0.273 = 0.0693. 

It would therefore require on the average about 1/0.0693 = 15 shots to 
get a single hit. 

Example 2. The mean errors for a certain gun at a range of 3000 
yards are 

= 8.3 yds., 7iy = 4.6 yds. 

If 30 shots are fired at the side of a house 12 yds. wide and 6 yds. high 
at a distance of 3000 yards, 
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(a) How many hits may be expected? 

(b) What is the chance of hitting a door 6 ft. X 3 ft. in the lower right- 
hand corner of the side of the house ? 

Solution, (a) If the gun is accurately aimed at the geometric center 
of the side of the house, any shot will be a hit if it passes within 6 yards 
of the central vertical line and within 3 yards of the central horizontal 
line. Hence we have 


x = % yds., y = 3 yds. ; and 


hx^ — 


0.5642X 0.5642 X 6 




8.3 


= 0.407, 


Tr 4-6 


Prom the probability table we find 

Px = 0.435, Py = 0.397. 
The chance of a hit for each shot is therefore 


P = PxPy = 0.435 X 0.397 = 0.173. 


For 30 shots the number of hits would probably be 30 X 0.173 = 5.2 or 
5, say. 

(b) To find the probability that the door would be hit during the 
bombardment we assume that the gun is aimed at the geometric center 
of the side of the house, as in (a). Then the door will be hit if a shot 
strikes within the rectangle bounded by the lines x = 5, x = 6, y = — 1, 
y = — 3. The chance of hitting the door at each shot is therefore 


L TT ® TT^ ^ TT c/ 0 

Hence the two values of hgX to be used in the probability table are 


0.5642 

8.3 


X 6 ==: 0.407 


and 


0.5642 

8.3 


= 0.340, 


for which the probabilities are = 0,435/2, = 0.369/2. Therefore 
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0.435 0.369 _ 0.066 

2 2 ~ 2 


Likewise, the two values of h^y are 


0.564a 

4.6 


X 3 =: 0.368, 


0.5642 

4.6 


X 1 = 0.1226. 


The corresponding probabilities are found from the table to be 
„ _ 0.397 „ _ 0.138 

Hence = 0.397/2 — 0.138/2 = 0.159/2, and we have finally 


P = P^XPv = 


0.066 X 0.159 
4 


0.0026. 


The door will be hit unless every one of the 30 shots misses it. The 
chance that any shot will miss it is 1 — 0.0026 = 0.9974. The chance 
that every one of the 30 shots misses is therefore (0.9974)*® = 0.9249. 
The chance of a hit is therefore 1 — 0.9249 = 0.0751. 

The door would probably be hit once out of the every 1/0.0026 = 380 
shots. 

Example 3. Find the number of shots necessary to make the odds lu 
to 1 in favor of at least one hit on the side of the house mentioned in 
Example 2. 

Solution. The house will certainly be hit at least once unless every 
shot misses it. The chance that any shot will be a hit was found to be 
0.173. The chance that any shot will miss it is therefore 1 — 0.173 
= 0.827. The chance that every one of n shots will miss it is then 
(0.827)". The chance of at least one hit is therefore 

P = l — (0.827)". 

Since the odds are to be 10 to 1 in favor of a hit, we have P = 10/11. 
Hence 

1 — (0.827)“ = ^, or (0.827)" = ^. 
n log (0.827) = — log 11, 


— lo^ 11 — 1.0414 

~ log 0.827 ~ 9.9175 — 10 


— 1.0414 

— 0.0825 


= 12.6 = 13, say. 


or 
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125. The Principle of Least Squares. Suppose we make a set of n 
measurements mi, m2, • • • m„ of some object or quantity in an effort to 
determine as nearly as possible its true magnitude, using the same care, 
methods, and instruments in making each measurement. If we try to 
read the measuring instrument to the finest subdivision of its graduated 
scale and even estimate fractions of a subdivision, we shall find that the 
results of the several measurements do not agree exactly among themselves, 
however much care we may use ; for each measurement is subject to unavoid- 
able accidental errors. How, then, shall we decide upon the best result 
obtainable from any given set of measurements or observations? 

This question is answered by the Principle of Least Squares, which 
says that the best or most probable value of the measured quantity is 
that value for which the sum of the squares of the errors is least. This 
answer is in accord with reason and common sense; for, since the acci- 
dental errors are real quantities their squares are positive quantities and 
the requirement that the sum of these positive quantities shall be as small 
as possible insures that the errors themselves shall be as small numerically 
as possible. 

Furthermore, the requirement that the sum of the squares of the errors 
shall be a minimum leads to the result that the arithmetic mean or 
average of the measurements is the best value obtainable from any set 
of equally trustworthy direct measurements. This result is also in accord 
with experience and common sense. 

The principle of least squares also follows from the Normal Law of 
accidental errors, as we shall now show. 

If we make a set of measurements all with equal care and use the same 
methods and instruments for each, the precision constant h of the prob- 
ability equation will be the same for all the measurements and the fre- 
quency of the accidental errors will be given by the same probability curve. 
If the accidental errors of the n measurements mi, m2, • * • mn be denoted 
by Xj,X2,' • * Xn, respectively, then the respective probabilities of these 
errors are 

p = -^e-*****^!,, P2 = ■ ■ ■ pn = . 

^ Vir Vw Vir 


Since the separate measurements are independent events, the probability 
that the set of errors Xi, X2, ‘’ will be made is the product of their 

separate probabilities, or 


(1) 


P = PlPz ■ 




^XidX2 


dXn 
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Now since small errors occur more frequently than large ones, a set 
of small errors is a more probable event than a set of large ones in 
making any set of measurements. Hence the set which has the greatest 
probability will give us the best or most probable value of the quantity 
measured; and since the differentials dx^, dxz, etc. are perfectly arbitrary 
quantities (the smallest subdivisions of a graduated scale, for instance) 
it is evident from equation (1) that this probability P is greatest when 
the exponent of e is least, that is, when 

iTi* -f- ^ 2 ^ + ' ' * + is a minimum. 

Thus, by the principles of probability we arrive at the Principle of 
Least Squares^ namely: 

The best or most probable value obtainable from a set of measurements 
or observations of equal precision is that value for which the sum of the 
squares of the errors is a minimum. 

Note. Any measurable quantity has a definite, true magnitude; and 
the differences between this unknown magnitude and the several measure- 
ments made to determine it are the true errors of those measurements. 
However, when these errors are required to satisfy the condition that the 
sum of their squares shall be a minimum, for the purpose of arriving at 
the most probable magnitude of the quantity, they become residual errors, 
or simply residuals (see Art. 127). But it is shown in Art. 129 that the 
sum of the squares of the residuals is least when the sum of the squares 
of the errors is least. 

126. Weighted Observations. If the measurements are not of equal 
precision, the values of h will be different. The probabilities of the errors 
will then be 

hi hz hfi 

Pi = e-*i*®"* dxi, pz = ^'*'*'** ' ■ Vn — Tr dxr , ; 

y TT \ IT V TT 

and the probability of their simultaneous occurrence will be 

(1) P = p^pz • • • Pn = ^tlr\n e“**^*-*^'*"^=*^^*^ • • • • dXn . 

\ \ ir) 

The best value obtainable from this set of measurements will therefore 
be that for which 

(2) 2 ^* 2 ;* = hi^Xi^ -f hz^Xz^ + ’ * + hn^Xn^ is a minimum. 

Since it is not customary in practice to make such an expression as 
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(2) a minimum, it is necessary to introduce hero the idea of weighted 
measurements or observations. By the weight of an observation is meant 
its relative value or importance when compared with other observations 
of a set. Thus, if we measure a line three times with the same care and 
accuracy, we regard the mean of the three measuremeents as more reliable 
than any one of the single measurements. We express this by saying 
that the weight of the mean is three times that of a single measurement. 
An observation of weight w is therefore one which is equivalent in impor- 
tance to w observations of unit weight. 

To find the relation between weight and precision index let 

h = precision index corresponding to weight 1, 

Ai = precision index corresponding to weight 

Then the probability of an error of magnitude x in the observations of 
unit weight is given by 



and the probability of an error of the same magnitude in a set of observa- 
tions of weight Wx is 


= 


hx 

—== e- dx. 


The probability of 
of unit weight is 

P = p • p • p ' 


the same error (of magnitude x) in observations 


• ' to 


/ h \w, 

factors := = \\7^ / {dx )^^ . 


Now if the weighted observation (wt. is to be worth as much as 
the Wx observations of unit weight, an error of magnitude x must have 
the same probability in it as in the case of the w^ observations. Hence 
we must have 

Pi = P> 


or 


hi / h \wi 


Wi 


for any x- Taking logarithms to the base e, we have 

hi _ _ . _ h 


log, log, 


+ (Wi — l)log, dx. 
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Equating coefficients of like powers of x. 

= or Wx = ^, 

Likewise, for observations of weights V)2, etc., we have 

h ^ 

= W2h^y or W2 = -j^ ; 

h * 

= w^h^, or Ws = ^2 ^ 

etc. 

The weights are therefore proportional to the squares of the precision 
indices. 

Substituting in ( 1 ) the values of h2^^ etc. as given above, we get 

P ~ *^nXn^)dx^dX2 • * • dXn . 

In order that P be a maximum we must have 

( 3 ) = iViXi^ + W2X2‘ + * • • + ti^nXn^ a minimum. 

We can now state the Principle of Least Squares in its most general 
form : 

The best value of ,an unknown quantity that can be obtained from a set 
of measurements of unequal precision is that which makes the sum of the 
weighted squares of the errors a minimum. 

127 . Residuals. In the preceding articles of the present chapter we 
have been discussing the errors . of observations and measurements. The 
true or exact magnitude of a quantity can not be found by measurement; 
for the unit of measurement and the quantity to be measured are, in 
general, incommensurable. Moreover, all measurements are subject to 
errors of some kind. It is obvious, therefore, that the error of a measure- 
ment can never be determined, the error being defined as the true value 
minus the measured value. What we actually do, and all we can do, is to 
measure the quantity as many times as may be desirable or convenient and 
then find from these measurements the most probable value of the measured 
quantity. The difference between the most probable value and any particu- 
lar measurement is called the residual for that measurement. For con- 
sistency in sign we always write 

Error = True Value — Measured Value. 

Residual = Most Probable Value — Measured Value 
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Let mo denote the most probable value of a measured quantity and let 
nil, • mn denote the \alues of n separate measurements. Then if 

Vi, V 2 ,' • ‘ Vn denote the residuals of these measurements, we have by 
definition 

Vi = TnQ — mi, 

V 2 — m^o ■■ nfi'2^ 


Vn = mo mn. 


128. The Most Probable Value of a Set of Direct Measurements. The 

definition of residuals leads us up to the problem of finding the most 
probable value of a set of measurements. Suppose we make n direct 
measurements on some unknown magnitude, how shall we determine the 
best value of the magnitude, on the basis of the n measurements? To 
give a general answer to this question we shall first assume that the 
measurements are of unequal weight. 

Let nil, 1 ^ 2 , * • • mn denote the n measurements and let Wi, * * • Wn 
denote their respective weights. Then if m denote the true value of 
the unknown magnitude, the errors of the several measurements are 


Xi=ni — nil, X2 = m — m2, • • • Xn = ra — mn . 


Now the true value m is unknown and can not be found, but we must 
adopt some value for it. The principle of least squares says that the 
best value is that which makes the sum of the weighted squares of the 
errors a minimum (Art. 126 ) ; that is, 

(1) /(w) = Wi{m — mi)^ tUzini — mo)^ + * * • + tVn(m — mn)^ 


must be a minimum. 

Differentiating (1) with respect to m, putting the derivative equal xo 
zero, and replacing m by mo, which is to be the adopted value of m, 
we have 

Wi{mo — mi) + Woinio — m 2 ) + • • • + ^^n(mo — m„) = 0, 


from which 

(128. 1) 


Wimi + W2m2 + • ' ’ + ‘^n'frin __ '^ wm 
+ • * • + tt'n 2 


This value mo is called the weighted mean of the several measurements. 
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If all the measurements are of equal weight, then Wx = W 2 = 
and (128. 1) reduces to 


( 128 . 2 ) 


mo 


mi + m2 + • ‘ ‘ + mn 
n 


9 


= fVny 


which is simply the average of all the measurements. This result is in 
accord with experience and common sense. 

Formulas (128.1) and (128.2) enable us to prove the following im- 
portant theorem : 

In any set of measurements of equal weight the algebraic sum of the 
residuals is zero, and in a set of measurements of unequal weight the 
algebraic sum of the weighted residuals is ^ero. 

To prove this theorem let mo denote the most probable value of the 
n measurements mi, m 2 , • * * m^ ; and let Vi, ^ 2 , ■ * * Vn denote the residuals. 
Then 

Vi = mo — mi, 

V2 = mo — m 2 , 


Vn = mo — mn . 

Adding these n equations, we get 

Vi + V2 + ’ • • -f Vn = nmo — (mi + ^2 + ’ * ’ + ^») 

= nmo — nmo=0, by (128.2). 

To prove the second part of the theorem let Wi, W 2 , ' ’ Wn denote the 

weights of the several measurements. The weighted residuals are 

WiVi = WiTtiq — iVimi , 

W 2 V 2 = Wzmo — W2m2 , 


WnVn = tt^nmo . 

Adding these n equations, as before, we get 

WiVi-\-W2V2-\- ' ‘ • == mo(t^i + ^2+ ’ ' ^n) — (tVimi v;2m2 + ' * •) 

= 0, by (128.1). 

This theorem provides us with a valuable check on the computed 
residuals in any set of measurements. However, since the residuals in 
such cases are rounded numbers their algebraic sum will rarely be exactly 


zero. 
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129. Law of Error for Residuals. We shall now show that when the 
errors of a set of measurements follow the Normal Law of error, the 
residuals likewise follow a similar law. To prove this let m denote the 
true value of the measured quantity ; mo the most probable value ; ci, € 2 , * ' ‘ 
the errors of measurement ; Vi, Vz, ‘ • * Vn the residuals ; and Wi, Wj, 
the weights. Then 


(V) 

Vi = mo — mi , 
V2 = mo — m 2 , 

Vn = mo — mn . 


(0 


Cl = m — mi , 

€2 — m^ — ffiz , 

c« = m — mn . 


For the case of measurements of equal weight we have from column (v) 

= nmo — ^m = 0, or mo = ; 

n 

and from column (<) we get in a similar manner 

2c = nm - — 2^> or 2^ = — 2«* 

Substituting this value of 5m in the equation mo = 5m/n, we get 

/.x nm — 2c 2c 

( 1 ) mo= ^=m — — . 

' ' n n 

Now substituting this value of mo in the equations of column (v), we have 


(2) 


Vi = m — — 2c — mi = m — rrii — — 2c = ci — “ 2c 
n n n 


= Cl ■ 


1 1 

— Cl C2 ■ 

n n 


1 

■ — c» . 
n 


or 


Similarly, 


/n — 1\ 11 1 

Vi = I I Cl Cn Cs ' ■ €n . 

\ n / n n n 

- 1 1 1 1 

— — ^ ”1 I ^ ^ ^ 

n \ n / n n 



We have thus proved that the residuals are linear functions of the errors. 
Hence by Art. 122 they follow the Normal Law. 
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If h is the precision index for the c’s and H that for the v% we have 
from (122.1) 


/n — ly 1 
1 \ n ) , n* 


n.' 




A* 


+ ^+ ■ ■ ■ + ^ [(« — 1)* + » — 1]. 




or 

1 n — 

1 1 

Hence 

n 

* 

(8) 

H = h^ 

^n—l 


Since the residuals follow the Normal Law, the probability equation 
for them is 


( 4 ) 


H 

y=—^ 


From (3) it is plain that the precision index for the residuals is a 
function of both h and n, and that it is always larger than h. This 
means that the graph of (4) rises higher in the middle and falls off 
more rapidly on each side than does the graph of (121. 1). As the 
number of measurements increases, the graph of (4) approaches that of 
(121. 1) more and more closely, and would ultimately coincide with it if 
the number of measurements were increased indefinitely. 

When the measurements are of unequal weight, the weighted residuals 
and weighted errors are as given in the columns {wv) and (t^^c) below. 


{wv) 

WiVi = WifilQ WilUi , 

W2V2 = iV 2 fno — WzTriz , 


Wi€i = WiTTl WiTrii , 

1V2^2 f 

Wn^n = WnWn . 


WnVn = WiTllo . 

On adding the equations (wv) we get 

'^wv = rrio — '^wm = 0, by ( 128. 1 ) . 
^wm 


rrio = 




By adding the equations in column {tve) we obtain 
= tn '^w — ^wm., or '^wm = m 
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Substituting this value of Swm in the expression for mo above, we get 
, ^ V m — ^we 


Hence 


Vi=: mo — nil = m — mi — 

__ . Wi€i W2€2 

2^ 2^ 


Wn€n 


Similarly, 


„ _ tV2 Ws Wn 

V Sti; / 2«^ 2w^ 

. t^2 \ «^3 y^n 

2«'*’ ■■■~2«’*“’ 


Hence in the case of measurements of unequal weight the residuals are 
linear functions of the errors and therefore follow the Normal Law. The 
residual Vi, for example, would follow the law 


where 


y = -^e-fW, 
Ytt 


1 ^ 1 r (2t^ — t^i)^ , 

Hi" {^wyL hy hyj * 


And similarly for the other residuals. 

On squaring and adding the n equations Vi = €i — (l/n)2c, V 2 = €% 
— (l/n)2€, etc., we obtain 

(7) 2v* = 2** — ^(2«)*, 

which gives the relation between the sum of the squares of the residuals 
and the sum of the squares of the true errors in any set of measurements 
of equal weight. Since both terms in the right member of (7) 'are 
positive quantities, it is evident that the sum of the squares of the residuals 
is always less than the sum of the squares of the errors, but that the 
difference is very slight. 

Inasmuch as the quantity St is very nearly zero in any set of measure- 
ments, the square of this quantity is still smaller and (l/n)(Sc)" is 
practically negligible in comparison with Sc". Hence any small shift 
in the values of the c’s would have very little effect on the already 



Art. 129] 


LAW OF ERROR FOR RESIDUALS 


423 


negligible quantity (l/n)(S€)*. We may therefore consider this quantity 
constant for small changes in the €% and then it is plain that is 
least when is least. 

This can also be shown in a different way. From equation (7) we have 

= 2 <* — + • • • + 
n 

VI 2 (^1^ “1“ + ■ ‘ “1“ “h 2 ciC 3 “h * * * “1- 

z= 

n 

Now when the number of measurements is large, the product terms 2cxC2, 
2«\€8, etc. will be about half positive and half negative; and they will 
average about the same size. Hence they will cancel one another for the 
most part and then reduces to 

2^2 — + ^2^ + “ • ‘ + 



From the foregoing considerations we are justified in asserting that 

The sum of the squares of the residuals is a minimum when the sum of 
the squares of the true errors is a minimum^ and conversely. 

In a similar manner, on squaring the n equations Vi = ci — ^wt/^Wy 
Vj = €2 — etc., then multiplying the squared equations by the 

corresponding weights W 2 , etc. and adding the results, we get 

( 8 ) 

ZdW 

Here, again, we see that the sum of the weighted squares of the 
residuals is a minimum when the sum of the weighted squares of the true 
errors is a minimum, and conversely, since the negligible quantity 
{l/%w) may be considered constant for small changes in the c^s. 

Remarks. Equation (1) shows that the arithmetic mean is equal to 
the true value of the quantity minus a very small quantity; for since the 
errors are as likely to be positive as negative the quantity is not large, 
and (l/n)2€ is still smaller. Hence the larger the number of measure- 
ments the nearer does mo approach the true value of the quantity measured. 
Equation (5) shows a similar result in the case of weighted measurements. 

Equations (2) and (6) show that any residual is equal to the corre- 
sponding error minus a very small quantity. Therefore when the number 
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of measurements is large the residuals are practically equal to the true 
errors. Hence, although we can never determine the true magnitude of a 
measured quantity we can determine it as closely as we please by taking 
enough measurements, 

130. Agreement between Theory and Experience. At the beginning 
of this chapter we described an experiment which was designed to show 
the behavior and distribution of accidental errors. In deriving the Prob- 
ability Equation we made the assumptions that the probability of an error 
depended upon its size and that positive and negative errors of the same 
size were equally likely. These two assumptions were supported by the 
pencil experiment. The first is based upon experience, but the second is 
evident on purely a priori grounds and also supported by experience. No 
rigorous deduction of the Normal Law, based upon purely a priori con- 
siderations, has ever been given. The truth is that, for the kinds of errors 
considered in this book (errors of measurement and observation), the 
Normal Law is proved by experience. Several substitutes for this law 
have been proposed, but none fits the facts so well as it does. 

To show how well the Normal Law agrees with experience when the 
number of measurements is large, we give in the table below the results 
of 470 observations made by Bradley on the right ascensions of the stars 
Sirius and Altair. 


Size of errors 

Number computed 
from theory 

Number actually 
found 

0^0 to OM 

95 

94 

OM to 0^2 

89 

88 

0'.2 to 0^3 

78 

78 

0^3 to 0\4 

64 

58 

to 0'.5 

50 

51 

0\5 to 0\6 

36 

36 

(r.6 to 0^7 

24 

26 

0".7 to Q\S 

15 

14 

0\S to 0^9 

9 

10 

o 

b 

5 

7 

over I'^.O 

5 

8 


It will be seen that the agreement between theory and experience is 
remarkably close, with the exception of the number of errors of magnitude 


from 0".3 to 0".4. 
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EXERCISES XIII 

1 . Compute the value of the integral correct to seven 

decimal places. 

2 . Compute the value of correct to five decimal places. 

3 . Find the probability of hitting at the first shot a rectangular target 
60 feet wide and 24 feet high at a distance of 4000 yards, the mean errors 
for the gun at this range being 

rij, = 7.4 yds., 7}y = 5.2 yds. 

4 . If 20 shots are fired at a cylindrical standpipe 120 feet high and 40 
feet in diameter at a distance of three miles, find the chance that the 
standpipe will be hit if the probable errors of the gun for this range are 

= 14.2 feet, fy = 10.6 feet. 

5- If the foretop of a battleship is a cylinder 12 feet in diameter and 
8 feet high, find the chance that it will be hit by a shot aimed at a point 
80 feet directly below, the mean errors for the gun in this case being 
Tfj. = 42.6 feet, rjy = 36.6 feet. 

About how many shots would have to be fired at the ship (aimed at a 
point 80 feet below the foretop) before the foretop would be hit? 

6. Twelve measurements of the length of a line are given below. Find 
the most probable length of the line. 


364.2 

364.2 

364.3 

364.4 

363.7 

363.8 

363.9 

364.1 

364.3 

364.3 

364.6 

364.0 


7 . Seven measurements of an object by different methods are given in 
the following table. If the weights of* the different measurements are as 
given in the table, find the most probable size of the object. 


Measurements 

Weights 

369.2 

2 

368*3 

1 

371.1 

3 

370.2 

5 

369 1 

2 

370 6 

4 

372.2 

1 


Compute the residuals and weighted residuals. Find the algebraic sum 
of the weighted residuals and the sum of the weighted squares of the 
residuals. 
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THE PRECISION OF MEASUREMENTS 

131. Measurements, Direct and Indirect. Direct measurements are 
those made by methods and instruments whose indications give directly 
the quantity sought. Such measurements are usually made by reading 
a scale graduated in terms of the chosen unit. Yard sticks, clocks, 
voltmeters, chemical balances, etc. are instruments for making direct 
measurements. 

Indirect measurements are those in which the quantity measured is not 
given directly by observation or readings taken, but must be calculated 
from them. Thus, in an indirect measurement the quantity sought is a 
function of one or more directly measured quantities. For example, if we 
measure two sides and the included angle of a plane triangle we can find 
the remaining side and \he area by means of the formulas 

a = — 2bc cos A, Area = ^bc sin A. 

Here the directly measured quantities are &, c, A, and the indirectly 
measured (computed) ones are a and the area. 

The relation between observed and computed quantities may be expressed 
by the general formula 

J/ — / (^l> ’ ■ ' d-t b^ C, ’ ' ) , 

where y and the a:’s represent observed or computed quantities and a, &, c, 
etc. represent numerical constants. 

132. Precision and Accuracy. The words ‘‘ precision ” and “ accuracy,” 
when used in the discussion of measurements, have quite different meanings. 
Precision has to do with accidental errors, and a precise measurement 
would be one free from accidental errors. An accurate measurement, on 
the other hand, would be one free from all kinds of errors — mistakes, 
systematic errors, and accidental errors. Barring mistakes, the systematic 
error is thus the difference between the precise value and the accurate or 
true value of the quantity measured. If the systematic error should 
happen to be large, a precise measurement might be very inaccurate. The 
accuracy of a measurement can be increased by using more refined instru- 
ments and methods, whereas the precision can be increased only by using 
more care in making the measurement. 
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I. DIRECT MEASUREMENTS. 


133. Measures of Precision. The precision of a measurement can be 
estimated in several ways. The three measures of precision in common 
use are the following: the mean square error (m.s.e.), the probable error 
(p.E.), and the average error. These three measures are denoted by the 
letters /x, r, and 77 , respectively. We shall now derive expressions for them 
in terms of the precision index h. 

(<a). The Mean Square Error (m.s.e.). In discussing the error equation 



in Art. 121 , we stated that h is called the index of precision and indicated 
the reason for this name. Then in Art. 125 we found that the probability 
of the simultaneous occurrence of a set of errors Xi, 2 : 2 , * ’ in a given 

measurement is 

(1 ) P = p^pz • • • e ‘ • • • dxn . 

\vw 

It was also shown in that article that the best or most probable result 
obtainable from a set of measurements is that corresponding to the 
maximum value of P. 

Let us now assume that a given set of n measurements has been made 
and let us try to find the best or most probable value of the precision 
index h for this set of measurements. It is that value which makes P a 
maximum and is found by differentiating P with respect to h and putting 
the derivative equal to zero. We thus get from ( 1 ) 


^ • •>[— 2h{x,^ + a;,* 4- . . . + 

_j_ = 0 , 

\v-/ 


or 


[_ + X2^ + - ■ • + + n] = 0. 

VVir/ V->r 

— 2 h^(xi^ X2^ + • • • + 4- n = 0, 


2h^ n 


A + a:./ + • • • + 

ky/2 ' n 


from which 
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The quantity on the right is usually called the mean square error 
(m.s.e.) of a single observation and is denoted by the Greek letter /*. 
We therefore have 



(b). The Probable Error (p.e.). The probable error, r, of a single 
measurement of a series is a quantity such that one half the errors of 
the series are greater than it and the other half less than it. In other 
words, the probability that the error of a single measurement will fall 
between r and — ^ is and the probability that it will fall outside these 
limits is J. Hence we must have 



v^r 2 


h 

or — = 

v 




• 4 




since the probability that an error lies between any given limits is repre- 
sented by the area under the probability curve between those limits. 

To find the value of r from the above equation we put 


Then 

and we have 


t = hx. 
dt — h dx. 


Now 


r , or r €~^'dt = 0.4431135, where p = hr. 

•Jo 4 c/ 0 


^2 6 ^ 24 120 


fe-‘‘df= rVl — <=*4- — — — — — + ■^< = 0.4431135, 

Jo J 0 \ ^ 2 6 ^ 24 120 ^ / 


or 

( 3 ) 


3 10 42 T 216 


1320 


— 0.4431135 r= 0. 


This is the equation which we have already solved in Art. 70 and found 
p = 0.4769363. The value of p can also be found by interpolation, as we 
liave already done in two ways in p]x. 2, Art. 26 and Ex. 1, Art. 29. 
Using now the relation p — hr, we get 



and from (2) we have 


0.4769 


0.47G9 



h 
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^ = vtV— • + 

n n 

Hence 

r = 0.4769 ' ' ' + 

^ n 

= 0.6745 + + - 

^ n 

r = 0.6745 .J ^i” + + ' ' ' + 

^ n 

(c). T’/ie average error is the arithmetic mean of all the errors of a 
set, without regard to signs. Thus, 

(5) = I a:i I + I a;^ I + • • • + I I 

To find an expression for rj in terms of h let us suppose that a set of n 

measurements has been made, and that each measurement is affected 
with an error of some size. In the case of any single measurement the 
probability of an error of magnitude x to x is approximately 

y£ix = {h/\^'ir)e'^*^^dkX (Art. 120). Hence the probable number of errors 
of this size in the n measurements is n times this probability, or 
The sum of these errors is therefore the number of 
errors times the size of a single error, or {nhx/ y/ ir) e~^*^^Ax. The sum of 
all the errors of all sizes is therefore 


or 

(4) 


' = r “ Jx =~ f "e-^'^'xdx 

•7 -CO y/ fr '\/ IT 0 

= C 2h^xdx) = ^ r e-**** 1 r 

h\/irJo ' hy/irL Jo 




Hence 


S = -^. 

hy/ir 


S 1 


^ hy/ TT 

134. Relations between the Precision Measures. From ('2) and (4) 
of Art. 133 we have 


( 1 ) 


r = 0.6745/i = roughly, 
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and 

( 2 ) 

Also, since 

we have 

( 3 ) 


0.6745 


= 1.4826r. 


i = V2 , V2 , 


= 0.78788. 
= 0.8/i,, approximately. 

__ V _ 


Hence 

( 4 ) 

Furthermore, from (2) and (4) we get 




1.4826r= 1 . 253377 . 


( 5 ) 

_ 1.2533 

■ ■ 1.4826 

and 


(6) 

_ 1.4826 

1.2533 


77 = 0.845377, 


r— 1.1829r. 


All these relations are shown concisely in the following table : 




r 

V 


1.0000 

1 4826 

1 2533 

r = 

0.6745 

1 0000 

0 8453 

v = 

0 7979 

1 1829 

1 0000 


135. Geometric Significance of 11 ., r, and tq. From the definition of r 
it follows that its corresponding ordinate to the probability curve bisects 
the area under that curve on either side of the y-axis. 

The quantity /i is the abscissa of the point of inflection of the prob- 
ability curve, as we shall now show. 

Taking the second derivative of 


and equating it to zero, we have 
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Hence 

or 






dx y/j 

2 K 

= — 2h^x^) = 0 . 




dx^ V^r 

1 — 2A»x* = 0, 



The precision measure rj is the abscissa of the center of gravity of the 
area (under the curve) on either side of the y-axis. To prove this we 

Y 



recall that if Xq denote the abscissa of the center of gravity of that area 
we have 







UH)dx 


area 


1/2 
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The relative sizes of the precision measures and their geometric relations 
are shown in Fig. 45. 

The question naturally arises as to which precision measure is the 
best for practical use. On this point there is no universal agreement. 
In continental Europe the m.s.e. is used almost exclusively, but in 
England and x\mcrica the r.E. is more often used. The average error 
is also used in America, but usually under the name average deviation. 

The M.S.E. is used almost exclusively in Mathematical Statistics, where 
it is called the standard deviation and denoted by a. 

The average error is llie easiest of all to compute, and the p.e. is the 
most laborious, because of the factor 0.6745. Nevertheless, in this book 
we shall conform to American practice and use the p.e. almost exclusively. 


136. Relation between Probable Error and Weight, and the Probable 
Error of the Arithmetic and Weighted Means. In Art. 126 we derived 
the relation between the precision index h and the weight w of an 
observation, namely: 


(136. 1) 


V\ W‘> Wn ' 


Then in Art. 133 we found the relation 


r = ^ , where p = 0.4769. 

Hence 

h = p . 

r 

Let Wi, Wn, * • * be the weights of observations whose probable errors 
are ri, r^, • • Tn, respectively. Then 



Substituting these values for h^,h 2 ,- ' ‘hn in (136. 1), we get 


_P^__ _ P — ... — J' 

TrTWn ’ 


or 

1 1 1 


r,^-Wn 

Hence 


(136. 2) 

— = "T ^ etc. 


etc. 
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The weights are thus inversely proportional to the squares of the probable 
errors. 


This relation (136.2) enables us to find the p.e. of the arithmetic and 
weighted means of a set of n direct measurements. 

To find the p.e. of the arithmetic mean of n direct measurements of 
equal weight, let the weight of each measurement be 1. Then the weight 
of the mean of all the measurements will be n. Denoting by r the p.e. 
of any single measurement and by r^ the p.e. of the mean of all the 
measurements, we have from (136.2) 


1^ 

n 



or 




r 


2 


n * 


Hence the p.e. of the mean is 


(136. 3) 


^0 = 


r 

Vn * 


If the measurements are not all of equal weight, let Wz, • • ' Wn 
denote their weights. Then if r denote the p.e. of a measurement of 
unit weight {w — 1) and 1 \ the p.e. of a measurement of weight Wi, we 
have from (136. 2) 


Hence 


w. 





r“ 

Wi ' 


(136. 4) 


Tx 


r 

ywx 


Now the weight of the weighted mean is %w = ' * • + 

Hence by (136. 4) the p.e. of this mean is 


(136. 5) ro =r - ^ . 

V y Wx + W.-\- ' ■ ■ + Wn 

Formula (136.3) shows that the p.e. of the arithmetic mean can be 
decreased by increasing the number of measurements. A glance at the 
graph of this equation shows, however, (see Fig. 46) that the decrease 
is very slight after several measurements have been made. Usually it 
does not pay to make more than ten measurements for the purpose of 
reducing the p.e. of the arithmetic mean. 

137. Computation of the Precision Measures from the Residuals. So 

far in our discussion of precision we have been considering the errors of 
measurements. Since the true errors can not be found, it is necessary 
to derive formulas for the precision measures in terms of the residuals. 
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In Art. 129 it was shown that when the errors of a set of measurements 
follow the Normal Law of error, the residuals likewise follow a similar 
law. The probability equation for any residual will therefore be of the 
form 

( 1 ) 


fo 



for measurements of equal weight, where 11 = — 1). (See Art. 

129.) For a set of n direct measurements of equal weight we therefore 
have for the n residuals the following probabilities: 

p, =: Pa = • • • p„ =: -^^er^^dvn . 

Vtt 

The chance that this particular^ set of residuals will be made in any set 
of measurements is then 

(2) P=:pip 2 - ' 'Vn— • * • dvn . 

Differentiating (2) with respect to H and putting the derivative equal 
to zero, exactly as was done in Art. 133, we get 

-- ^ 2 ^ 4 - • • ' + Vn 

Hy/2 ^ n 
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Hence 


, and = a . 

hy/2 


7/ Vs feVS’ » ^ 


n — 1 
n 


/v.* + %“ + •• 

■ -j- 

^ n 



Therefore 

(137. 1) 


,, _ JVx- + + • • • + V _ . / 

^ n — 1 -^n — l' 

r = 0.6745/i = 0.6745 . 

^ n — 1 


For the p.e. of the arithmetic mean we have 

(137. 2) r„ = -^ = 0.6745 J - • 

^ n( n — 1) 

If the measurements are not all of equal weight, the residuals will not 
have the same weight. They can all be reduced to unit weight, however, 
by multiplying each of them by the square root of its weight. This 
follows from (136.4), since ri^Wi = r. 

Let Vi, V 2 ,- '- v„ be the residuals of n measurements of weights 
Wi,W 2 y- ■ ■ tUn- Then the residuals reduced to unit weight are 

• V\ = , 

v'2 = Vzy/wz , 


V'n = VnV Wn . 

Squaring these equations and adding, we get 

(6) z= 

Now for a set of measurements of equal weight we have from (137. 1'l 


r — 0.6745 




Replacing 2v'* by its equal from (6), we get 
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(137. 3) r = 0.6745 = 0.6745 + • • • + w^Vn^ 

^n — 1 ^ n— 1 

This is the p.e. of a single measurement of unit weight. 

To find the p.e. of a measurement of weight Wi and the p.e. of the 
weighted mean we have from (136.4), (136.5), and (137.3) 


(137. 4) 
(137. 5) 


Ti — — = = 0.6745 






To = 




(n — l)Wi 
0.6745 yj. 




(n — 1)2^^ 


It will be observed that (137. 5) reduces to (137. 2) when all the weights 
are equal. 

We now collect for easy reference the fundamental formulas for com- 
puting the P.E. of direct measurements. 

(a) Measurements of equal precision, p.e. of a single measurement: 


(137. 1) r = 0.6745 

P.E. of arithmetic mean: 

(137. 2) ro — 0.6745 




+ Vi +■ • ■ + Vn’‘ 

n — 1 


JVjfjV 


4 - • • • + 


n(n — 1) 


(b) Weighted measurements, p.e. of a single measurement of unit 
weight : 

(137. 3) r = 0.6745 . 

^ n — 1 

P.E. of measurement of weight w^: 


(137. 4) n — 0.6745 ' ■ + Wnt’«- 

^ (n — l)v)i 

P.E. of weighted mean : 

(137. 5) ro = 0.6745 J w,v^Jr^2V-J‘ + - ' . 

' (n — l){Wi + tii2 + ■ • ■ + w„) 


138. The Combination of Sets of Measurements when the P.E. 's of 
the Sets are Given. When several separate determinations of the magni- 
tude of a quantity have been made by different observers or by different 
methods and the probable errors of the separate determinations are given, 
it is important to know just how to combine these several results so as 
to obtain from them the best value for the measured quantity and the 



akt. las] 


COMBINATION OF SKTS OF MEASUREMENTS 


437 


probable error of this best value. For example, the results of five different 
determinations of the atomic weight of silver are given below. How can 
we obtain from them the best value for the atomic weight and how can 
we find the r.E. of this value? 

107.9401 d= 0.0058 
107.9406 It 0.0049 
107.9233 zb 0.0140 
107.9371 Hh 0.0045 
107.9270 zb 0.0090 

This is really a problem in indirect measurements, but it can readily 
be solved by the methods already given. The proper method of procedure 
in a problem of this type is first to compute by the relation (136. 2) the 
weights of the several determinations from their given probable errors 
and then find the weighted mean of the given values of the measured 
quantity. The p.e. of this weighted mean is to be computed by formula 
(136.5). See Example 4. 

Note, Some authors compute the p.e. of the weighted mean in this 
case by finding the residuals of the sets of measurements and then finding 
the P.E. of the weighted mean by formula (137.5). Such a method is 
incorrect, and the p.e. of the weighted mean found by this procedure 
may be worthless. For an investigation of this matter from several angles, 
see the following papers: 

1. The Invalidity of a Commonly Used Method for Computing a 
Certain Probable Error.” Proc. Nat. Acad. Sci., Vol. 15, No. 8 (August, 
1929), pp. 665-668. 

2. On the Computation of the* Probable Error of a Weighted Mean.” 
Am. Math. Monthly, Vol. XLII, No. 5 (May, 1935) pp. 286-301. 

We shall now show the use of the formulas derived in the preceding 
sections. 

Example 1. The following measurements were made to determine the 
length of a base line in ’ a geodetic survey. Find the most probable 
length of the line, the p.e. of a single measurement, and the p.e. of the 
arithmetic mean. 

Solution. The measurements, residuals, etc. are arranged in tabular 
form as shown below. The first step in the solution is to find the arith- 
metic mean of the given measurements. Then the residuals are found 
by subtracting each measurement from the arithmetic mean. 
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Ml = 455.35 

Vi = — 0.02 

Vi* = 0.0004 

M 2 = 455.35 

V2 = — 0.02 

Vjs* = 0.0004 

JIfs = 455.20 

Vg = + 0.13 

V = 0.0169 

Ml = 455.05 

V 4 -|- 0.28 

V 4 * = 0.0784 

Ml = 455.75 

Vo = — 0.42 

V 5 * = 0.1764 

M, = 455.40 

Ve = — 0.07 

V,* = 0.0049 

M, = 455.10 

V7 = + 0.23 

v,* = 0.0529 

M, = 455.30 

Vs = + 0.03 

Vs* = 0.0009 

Mt = 455.50 

i ;9 = — 0.17 

V = 0.0289 

Mio = 455.30 

^10 — "h 0.03 

Vio® = 0.0009 

SJIf = 10 X 455 .+ 3.30 

M 

II 

0 

2v* = 0.3610 


Mo 


10 X 455 + 3.30 
10 


455.330. 


rr= 0.6745 


/ 0.3610 
^ 9 


= 0.135, by (137.1). 


fo = = 0.043, by (137. 2). 

Vjo 

The length of the line is therefore to be written 
M — 455.330 ih 0.043. 


Note. The number of significant figures to be recorded in the most 
probable value (arithmetic or general mean) is usually one more than 
the number given in the individual measurements (Art. 7). If the P.E. 
of the final result should be relatively large, however, we are not justified 
in recording this result to more figures than are contained in the separate 
measurements, and in such cases we record the final result to the same 
number of figures as given in the data. 

The P.E. of the result is recorded to only one or two significant figures — 
just enough to extend to the last figure of the mean. Slide-rule accuracy 
is therefore amply sufficient in .the computation of probable errors. 

In finding the residuals we use only as many figures in the mean as are 
given in the individual measurements. 

Sometimes too much importance it attached to the probable error of a 
mean and too little to the mean itself. The mean is the important thing 
in any set of measurements or in any combination of sets; the probable 
error is of secondary importance. Theoretically, the weights of the separate 
means shquld be used in computing the general mean, but in the com- 
bination of only a few sets of measurements — from two to five, for 
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example — such a procedure is of doubtful value. When only a few sets 
are to be combined, the simple average is usually better than the weighted 
average and is much easier to compute. 

Example 2. The following measurements were made to determine a 
certain wave length. Find the most probable wave length and its p.e. 

Solution. Here we first find the mean and then the residuals as before. 
The rounded mean is correct to its last figure as given, but since the last 
digit is slightly less than 5 the mean when rounded to three decimals is 
4.505. From this number we subtract the individual measurements to 
find the residuals. 


n 

M 

V 


1 

4.524 

— 0.019 

0.000361 

2 

4.500 

+ 0.005 

0.000025 

3 

4.515 

— 0.010 

0.000100 

4 

4.508 

— 0.003 

0.000009 

5 

4.513 

— 0.008 

0.000064 

6 

4.511 

— 0.006 

0.000036 

7 

4.497 

+ 0.008 

0.000064 

8 

4.507 

— 0.002 

0.000004 

9 

4.501 

+ 0.004 

0.000016 

10 

4.502 

+ 0.003 

0.000009 

11 

4.485 

+ 0.020 

0.000400 

12 

4.519 

— 0.014 

0.000196 

13 

4.517 

— 0.012 

0.000144 

14 

4.504 

+ 0.001 

0.000001 

15 

4.493 

-f 0.012 

0.0001 4 

16 

4.492 

+ 0.013 

0.000169 

17 

4.505 

0.000 

0.000000 


Mo = 4.5055 

= — 0.008 

2^== = 0.001742 


r„ = 0.6745 = 0.0017, by (137.2). 

^ 17 X 16 

.•. M — 4.5055 ± 0.00^7. 


Remark. Theoretically the algebraic sum of the residuals should be 
zero, but since these residuals in any actual problem are necessarily rounded 
numbers their algebraic sum is rarely zero. However, if the algebraic 
sum of the residuals is not practically zero, there is a numerical mistake 



440 


THE PRECISION OF MEASUREMENTS 


[Chap. XV 


either in the mean or in some residual. Hence it is very important to 
check the computation by noting whether 2v is practically zero. 

Example 3, Six measurements of the parallax of a star are given in 
the following table. Find the most probable value of the parallax and 
its P.B. 


M 

w 

wM 

V 


wv^ 

0V507 

8 

4 056 

-0 104 

0 010816 

0 086528 

0^438 

5 

2 190 

-0 035 

0 001225 

0 006125 

00 

eo 

o 

2 

0.762 

0 022 

0 0004S4 

0 000968 

0V371 

8 

2 968 

0 032 

0 001024 

0.008192 

0V350 

13 

4 550 

0 053 

0 002809 

0 036517 

o 

O 

to 

20 

8 040 

0 001 

0 000001 

0 000020 



J^wM 





Sw; = 56 

= 22 566 



i:uit’» = 0 13835 


To -- 

Hence the final result is 


= 0-'.403. 

56 

0.6745 = 

^ 5 X 56 


M = 0".403 ± 0".01 


: 0.015. 

5. 


Here the p.e. of the weighted mean is so large (relatively) that we are 
not justified in recording the result to more figures than are given in 
the data. 


Example Seven separate determinations of tlie difference of longi- 
tude between two places gave the following results. Find the most 
probable value of the longitude difference and its p.e. 


1 

19'" 

1^42 ± 0\044 

2 

19 

1 .37 d_ 0 .037 

3 

19 

L.38 d:: 0 .036 

4 

19 

1 .45 ± 0 .036 

5 

19 

1 .60 ± 0 .046 

6 

19 

1 .55 db 0 .045 

7 

19 

1 .57 zh 0 .047. 

Solution. 

The first step in 

the solution of this problem is to find the 


weights of the different determinations from their given probable errors. 
From Art. 136 we have 
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Hence 


1 _ 1 _ 
Ti^Wi = r^-Wi 


1 1 

— - — = - , say. 
r-iW-i c 


= = c. 


Let us take the weight of the last determination as unity, that is, let 
us put 

Wi = 1. 


Then 

Hence 


(0.047) ^ 

‘ \0.044/ \44/ 

c /0.047\^ /47y_ 


In like manner we find 

«;3 — 1.70, w^ = \SiO, «;5 = 1.04, t<;e = 1.09. 

To save labor in the computation of the weighted mean let us denote 
by di, do, • • ■ dr the differences between the various determinations and 
an assumed approximate value of the weighted mean, say 19"™ 1®.40. Then 
the various determinations are 19"™ 1®,40 + di, 19*” 1®.40 + d 2 , etc.; and 
their weighted mean is 

(19”M®.40 + d,)w^ + (19 *”1®.40 + d,)wn -f- — • + (19*”1®. 40 + d- j)w^ 
Mq = + • * * + 

n)^ _]_••• w^){19^1^A0) -|- iP\di -f- iU2d2 ’ ~f~ '^^hd ^ 

— -|- • • • -[- 
Wid, + w'jdj + • • + 'ff'-.d7 

= 19*”P.40 j ■ . 

w.’i + «;2 + ' ' + ^^7 

This equation shows that it is necessary to multiply only the d"s by 
the weights. We therefore complete the solution by making out the table 
shown below and then using (136. 5). 


19® I*. 42 
19 1 .37 

19 1 .38 

19 1 .45 

19 1 .60 
19 1 .55 

19 1 . 57 


d 

W 

wd 

0 02 

1 14 

0.023 

-0 03 

1.61 

-0.048 

-0 02 

1.70 ' 

-0.034 

0 05 

1.70 

0 085 

0 20 

1 04 

0 208 

0 15 

1.09 

0 164 

0.17 

1 00 

0 170 


2:w; = 9.28 

Zu'd-O 568 
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Hence 

Mo = 19“ 1*.40 + = 19“ 1«.40 + 0.061 19“ 1«.461. 

9.28 

Then since the weight of Jfr is assumed to be 1, we substitute the value 
of r 7 in the formula (136.5) and get 


To 


0.047 


0«.015. 


.'. M = 19"* 1®.461 zt 0«.015. 


Note. The reader is reminded that the expression Jlf = JI/q di r does not 
mean that the true value of M is somewhere between ilfo + r and Mq — r; 
nor does it mean that M is probably in error by the amount r. It means 
that, so far as accidental errors are concerned, the true value of M is just 
as likely to lie between r and Mq — r as it is to lie outside of these 

limits. 


EXERCISES XIV 

1. Ten measurements of equal precision were made to determine the 
density of a body, the results of the measurements being as follows : 9.662, 
9.673, 9.664, 9.659, 9.677, 9.662, 9.663, 9.680, 9.645, 9.654. Find the 
probable error of a single measurement, the most probable value of the 
density, and its p.b. 

2. Twelve measurements of an angle in a primary triangulation gave 
the following results. Find the p.e. of a single measurement, the most 
probable value of the angle, and its p.e. 


116 43' 44". 45 

116 43' 51" .75 

50 .95 

52 .35 

49 .20 

51 .05 

47 .40 

49 .05 

Si .05 

49 .25 

50 .60 

49 .25 


3. Ten measurements of the coefficients of expansion of dry air gave 
the following results. Find the most probable value of the coefficient and 
its P.E. 


3.643 X 10-" 
54 
44 
50 
53 


3.636 X 10-« 
51 
43 
43 
45 
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4 . A certain coefficient of expansion was measured with different 
apparatus with the following results. Find the best value for the coefficient 
and its p.e. 


Measurement Weight Measurement Weight 
0.0045 3 0.0036 2 

0.0039 2 0.0026 2 

0.0034 5 0.0027 1 

0.0030 4 0.0043 3 

5. An angle was measured several times with a transit and then several 
times with a theodolite, with the following results: 

Theodolite 36° 41' 28" dt 11" 

Transit 36° 41' 23".8 ± 2".7 


Find the most probable value of the angle and its p.e. 

6. Six determinations of the velocity of light by different observers 
at different times gave the following results, with their probable errors: 

298000 dz 1000 
298500 ± 1000 
299930 It 100 
299990 It 200 
300100 It 1000 
299944 It 50 

Find the most probable value obtainable from these determinations and 
its P.E. 

7. Find the best value of the atomic weight of silver and its p.e. from 
the following determinations: 

107.9401 It 0.0058 
107.9406 It 0.0049 
107.9233 It 0.0140 
107.9371 It 0.0045 
107.9270 It 0.0090 

II. INDIRECT MEASUREMEI^TS. 

139. The Probable Error of any Function of Independent Quantities 
Whose P. E.’s are Known. 

Let 

( 1 ) 


Q — /(9i^92^9s, * * 9») 
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represent any function of directly measured quantities qi, • ' * qn. 
Then errors Agg? ' ' * Agn in the g’s will cause an error AQ in the 
function Q, so that 

Q + = /(^i + <l2 + 


Expanding the right-hand member by Taylor^s theorem and proceeding 
exactly as in Art. 6, we get 

(3) AG = |^ Ag,+ g- Ag, + - • ■+ g 

This expression for aQ holds for any kind of errors whatever. If 
Agi, Ago, • • • Ag„ are accidental errors, so that they obey the Normal 
Law of error, then AQ is likewise an accidental error which obeys the 
Normal Law, as proved in Art. 122. In this case equation (2) is exactly 
like equation (2) of Art. 122, and all the results of that article apply to 
it. Hence if H, hi, / 12 , • * • hn denote the precision indices of Qi, gi, 
? 2 , • • • (Iny respectively, we have from (122. 2) 



Let us denote the probable errors of Q, gi, ' ' Qn by Ri, n, rz, • • -rn, 
respectively. Then from the relation p hr found in Art. 133 we have 


1 


^ ^ ^ 1 ^ 

' h^ ^ p^ ' hz^ ~ p^ ' 


^ 2 , where p ~ 0.4769. 


Substituting these values of 1/H^, l/^l^ etc. in (3) and reducing, we get 


( 139 . 1 ) 


R = 





This formula is of great importance, for it includes all possible cases 
of a function of directly measured quantities. It expresses the law of 
the propagation of errors and is the foundation of the whole subject 
of indirect measurements. 

The terms relative error and percentage error may also be applied to 
probable errors. The fundamental formula for the relative error in indirect 
measurements is obtained by dividing (139.1) throughout by Q. We 
then have 


R 

Q 



^qn) 


(139. 2) 
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for the probable relative error. The probable percentage error is 100 
times this. 

Formula (139. 2) assumes a very simple form when Q happens to 
be a product of several functions or a logarithm of a single function. 
Suppose, for instance,. that 

(139. 3) Q = . 

Then 

dQ Qm ^ dQ Qn ^ dQ Qp 

dx X dy y dz z ^ 

and when these are substituted in (139. 2) we get 
(139. 4) 




for the probable relative error of Q. 

It is worth while to notice here that the p.e. of the weighted mean 
of several sets of measurements whose p.e.^s are given (Art. 138) can 
be found by the methods of the present article; for the weighted mean 
may be written in the form 

IT TIT I ^’2 T^r , , 

which is a linear function of the Jl/’s. Hence on substituting in (139. 1) 
the partial derivatives = Wi/^Wy dM^/dMz = etc., we get 


( 4 ) 


R 


= 4 : 


W, 


ri^ + 


V', 


r," + 


But since ry = c/Wi, = c/w^, etc., we have 


. il'n_ 

■+ (twY- 


n — \\ — 4- • 


■ + 


W„- 


(2w)^ «’n 


= + • • • + M’n = ^7 = 


Vc 


Vc 


Now if we take Wi = l (t = 1, 2, • • • n), we get c = u and therefore 


R = 




which is formula (136.5). 
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On putting Wx = W 2 = 
Then (4) reduces to 


which is formula (136. 3). 


= Wn we get ri = rz 



rn, by (136. 2). 


140. The Two Fundamental Problems of Indirect Measurements. The 

two main problems of indirect measurements are the following: 

1. Given the p.e.’s of a number of directly measured quantities, to find 
the P.E. of any function of these quantities. 

2. Given a prescribed p.e. of the function, to find the allowable p.e.^b 
of the directly measured quantities. 

The first of these problems is solved by substituting the data directly 
in formula (139. 1) or (139. 2), according as the given p.e.^s are absolute 
or relative. 

The second problem is mathematically indeterminate when the number 
of directly observed quantities is greater than one. For a function of a 
single quantity, say 

Q = fi^), 

we have by (139. 1) 





n. 


or 


ri 


A 

dx 


IJfOa). The Method of Equal Effects. If, on the other hand, ^ is a 
function of several directly measured quantities, we obtain a definite 
solution by using the method of equal effects, as explained in Art. 10. 
This method assumes that all the components (directly measured inde- 
pendent quantities) contribute the same amount to the resultant error in 
Q. Under these conditions all the terms under the radical in (139. 1) 
are equal to one another, so that 


Hence 

(1) 




r-dQ 

V n ^ . 

oq„ 


R 


R 


R 


ri =■ 


rdQ 


rj =■ 


v« 


dqs 


oqn 


In some problems the p.k’s of some of the components are so small 
in comparison with the others that we may neglect them entirely when 
applying the method of equal effects, thereby simplifying the problem. 
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Thus, if we wished to find the local time at any place on the earth’s 
surface, we could compute it from the formula 


cos t = 


sin h 

cos L cos d 


— tan L tan d 


as soon as we knew the altitude (h) and declination (d) of a heavenly 
body and the latitude (L) of the place. The declination can be found 
from the Nautical Almanac to a hundredth part of a second of arc, but 
the altitude and latitude have to be measured at the place where the local 
time is wanted. If these are measured with a sextant or an engineers’ 
transit, they can not be measured much closer than to the nearest minute 
of arc. Hence the declination is known so much more accurately than 
the altitude and latitude can be measured that we may treat the declination 
as free from error, so that the error in t will be due entirely to the errors 
in h and L. If, therefore, we desired the local time to the nearest 
second, we would treat ^ as a function of h and L alone, take n = 2, and 
find the allowable p.e.’s of h and L by means of formulas (1). 

To find out whether the error in any particular component has a 
negligible effect in producing an error in the function Q we apply the 
following criterion: 


IJfOb), Criterion for Negligible Effects: If any component qk has a 
negligible effect in causing an error in Q, then we must have * 


( 2 ) 




where R is the stipulated p.e. of Q. If several components ?i, q 2 , • • q„ 
should each satisfy (2), they may all be neglected provided 


( 3 ) 


A 




+ 


(g) 


+ • • • + 



2 1 


When applying the criteria (2) and (3) to any particular problem, 
we are supposed to know in advance the size of the p.e.’s of the components 
we contemplate neglecting, as in the case of the declination d in the 
astronomical problem mentioned above. If we know nothing concerning 
the size of the p.e/s whose effect we contemplate neglecting, then the 
best we can do is to apply the method of equal effects to the terms under 
the radical in (3), thereby obtaining 



^00 , — dQ ,—dQ 

= V ra = ^ -R, 

dqi cq2 cqm 3 


See Palmer’s Theory of Measurements, p. 151. 
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from which 

n ; 


R 


R 


R 


3Vm^ 


To :S: 




dq. 


3Vm|^ 

dqm 


We may therefore neglect the effect of m components q^, qz, ' ' ' qm it 
each satisfies the condition 

R 

(4) r, ^ , (A: = 1,2, 3,- • • m). 

o,/~9G 

6y 

dqic 


The proofs of criteria (2) and (3) are simple and easy, but they will 
not be given here.* 

We shall now apply the preceding formulas to some examples. 

Example 1. From the simple pendulum formula 


r = -T V- 

we get 

9 = ~=f(l,T). 


If I = 100 cm. and T = 1 sec., find the error in g due to errors of 0.10 cm. 
in I and 0.0020 sec. in T, respectively. 

Solution. Differentiating g with respect to I and T separately, we have 


dl ~~~ T^' dT~ T" ‘ 


From this point onward we proceed in one of two ways, depending on 
the meaning of the errors in I and T. 

(a) If the errors in I and T are actual, definite errors of the magni- 
tudes given, then we compute the error in g by the formula 


A Kl I A 7^ 


[See (6. 1)] 


Hence 




-AT 


2^2 J'* 

= 9.8696(0.10 + 200 X 0.002) = 4.935 cm./sec.* = 4.9, say. 
Since we do not know the signs of AT and AZ, we disregard the negative 


Kee Palmer’s Theory of Measurements, p. 151. 
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sign on the right and take the arithmetic sum of the terms. This gives 
the maximum numerical value of A^. 

(b) If the given values of Z and T are the means of several measurements 
and their given errors are the p.e.^s of these arithmetic means, then we 
compute the p.e. of g by formula (139. 1). Hence we have 


^ = 9.8696V0.01 + 0.16 

— 9.8696 X 0.4123 =: 4.068 cm./sec.^ 4.1, say. 


To find the relative and percentage errors under the two suppositions 
(a) and (b), we Iihyg 


(a) 


Relative error = — ^ i=z 2 


9 




T 


0.j^_^ 2(0.002) 

Too ■ ' 1 


= 0.001 + 0.004 =: 0.005. 


Percentage error := 100 (A^/^) — 100 X 0.005 = ^ per cent. 

(b) Since we are here dealing with a product of several quantities, we 
use formula (139.4). Hence 


^ = V(x) + V (0.001)“= -f 4(0.002)^ 

= 0.00412 = 0.004, say. 

Percentage P.i?. = 100 = 100 X 0.004 = M percent. 

Example £. Two sides and the included angle of a triangle were 
measured with the following results: 

a = 252.52 ± 0.06 feet, 
b = 330.01 ± 0.06 feet, 

C = 42°13'00" ± 30". 


Find the area of the triangle and its p.e. 
Solution. The formula for the area is 


A = ^ab sin C. 

Hence 

3A b sin C dA a sin 0 dA ab cos 0 

^ 2 ’ dO ~ 2 


Since the errors given in this problem are the probable errors of the 
given measurements, we should use formula (139.1). The use of that 
formula in this example, however, would call for a considerable amount 
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of numerical work. To avoid this we calculate the relative error by 
formula (139. 2) and then get the p.e. from the relative error. Hence 
we have (139. 2) 

z = + (t) + 

The error in C must be expressed in radians. Hence 

AC =30X5^5X3^ = 0.0001454. 

Also, cot C = cot 42° 13' = 1.1022. 

• 3 = + (3^) + X = 

= 0.00035. 

The area is 

, 252.52 X 300.01 X sin 42°1 3' 

A = r = 25452 sq. ft. 

R = 0.00035 X ^ 0.00035 X 23452 = 8.9 = 9, say. 

The required result is therefore 

A = 25452 ±: 9 sq. ft. 


A 



Fio. 47 


Example 3. The distance between two inaccessible points A and B is 
desired to ±: 0.1 foot. The required distance can not be measured directly 
but must be calculated from the measurements of CA, OB, and AACB. 
If a, b, and 0 (see Fig. 47) are approximately equal to 200 ft., 150 ft., 
and 45°, respectively, find the allowable errors in these directly measured 
quantities. 
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Solution, Here 
and 


c= V — 2a6 cos 6, 

R = 0,1. 


The best way to solve this problem is by the method of equal effects, and 
we therefore use formulas (1). Differentiating c with respect to a, 6, 
and 9 in turn, we have 

8c a — h cos 9 8c h — a cos 9 8c db sin 9 

da c ’86 c ^ d9 c ’ 


But c = V 40000 + 22500 — 30000 \/2 = 141.7 

. 8c _ 200 — 75 V^_ 93.93 
■ * 8a 141.7 “ 141.7 ~ ’ 


^ _ 150 — 100 V 2 _ 8.58 
86 "" 141.7 ~ 141.7 


0.060, 



200 X 150 X 


V2 


141.7 


and n = 3. 

Then by (1) we have 


_ 21213 
“ 141.7 


149.7; 


0.1 


0.1 


V3X0.66 


0.1732 

1.98 


= 0.087 = 0.09 ft. 


r„ = 


rt = 


0.1 


0.1732 


V3 X 0.06 

0.1 


0.18 
0.1732 


= 0.96 ft. 


V3 X 149.7 449.1 


= 0.000386 rad. = 1'20'' 


The large allowable error in 6 is due to the fact that 6 is nearly perpen- 
dicular to c, so that a considerable change in the former has little effect 
on the latter. 


Example Jf. The modulus of elasticity of a beam of length I, breadth 
6, and depth d, supported at the ends and loaded at the center by a 
weight Wy is given by the formula 


WP 
4a6 d® 


> 


where a is the deflection produced at the center. If it is desired to 
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measure to 1 per cent, and the error in W may be neglected, compute 
the allowable errors in a, fe, d, and 1. 

Solution, The formula for E may be written 

This is of the form (139. 3), where K = W/4. Then since R/E = 1% 
= 0.01, we have from (139.4) 


o.m _ V + (~) + (t) 

Now using the method of equal effects, we have 




d J- 


Likewise, 


I 


V 4 X 9 (y) = 0 01, or 6(^y) = 0.01. 

0.01 


AZ 1 

and 100"- - = 0.167 per cent. 

L 6 


V 4(— y= 0.01. or — = 0.005. 
^ \ a / a 

, Afl^ 

. . 100 — =0.5 per cent. 

a — 


A6 

100-^ = 0.5 per cent. 

100^ = i =: 0.167 per cent. 
cL D 

Hence if the percentage p.e. of E is to be 1 per cent, the percentage 
P.E.’s of a, h, dj I, must not exceed J, J of one per cent, respectively. 


141. Rejection of Observations and Measurements. Occasionally some 
individual measurement may differ so widely from the others of the 
same set that we may suspect the discrepancy to be due to a mistake. 
In such a case it may be well to reject this measurement entirely. To 
decide what to do about it we apply the following rule: 

Find the mean of all the measurements {including the wild*^ one) 
and find the residual for each. Compute the p.e of a single measurement 
hy formula (137. 1). Reject any measurement whose residual exceeds 5 
times the p.e. of a single measurement. 

This rule rests on the following considerations: 

Suppose the chance of an error of magnitude a; is 1 in 1000. Then 
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its probability is p = l/lOOO = 0.001. The chance that an error of this 
size will not occur is therefore 1 — 0.001 = 0.999. From the probability 
table we find the corresponding Kx to be 2.326. 

Now from Art. 133 we have 


from which 


Hence 


hrz=zp = 0.4769, 
, 0.4769 


hx = 


0.4769 

r 


X = 2.326. 


to two figures. 


2.326 

0.4769 


r = 4.9r, 


The chance of making an error as great as five times the p.e. of a single 
measurement is therefore less than one in a thousand. An error of such 
a magnitude is therefore so improbable that we may safely neglect it. 

Example, A quantity M was measured with the results given below. 
Should any of the measurements be rejected ? 

M = 236, 251, 249, 252, 248, 254, 246, 257, 243, 274. 

Solution. The average of these measurements is 


Hence the residuals are 


M =251. 


Vi — “1“ 15, V 2 — 0, ^3 — 2, V 4 — — 1, Vg -|- 3, v^ = — 3, 

Vt = + 5, Vs= — 6, Vg = + 8, Vio =: — 23. 

The P.E. of a single measurement is 


r = 0.674 


5 V- 


1225 + 4 + 1 + 9 + 9 + 25 + 36 + 64 + 529 
9 

= 0.6745^X 10.01 = 6.75. 

Five times this p.e. is 33.75, and since all the residuals are less than 
this we retain all the measurements. 


EXERCISES XV 

1 . The side b and the angles B and (7 of a plane triangle were measured 
with the following results: 

6 = 106 dt 0.06 ft., B = 28^36' ±1', C = 120°12' it 1'.5. 

Find the angle A, the side a, and their p.e.^s. 
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2. Two sides a and h and the included angle C of a town lot were 
measured to be 

a = 104.86 ± 0.02 ft., h = 214.24 ± 0.03 ft., 

C = 47®13'± 1'. 

Find the side c and its p.e. 

3 . The index of refraction of a prism is given by the formula 

__ sin ^(a + Z>) 
sin \a 

If 2> = 28°34' ± 0'.5 and a = 62^48' ±: O'. 7, find n and its p.e. 

4 . The current in a tangent galvanometer is given by the formula 

I = K tan B. 

Find I and its p.e. when K = 1.963 ±: 0.002 and B = 35® ± 0®.l. 

5 . The volume of a right circular cylinder is given by the formula 

V = 

4 

Find V and its p.e. when h = 116.85 d: 0.28 mm. and d = 82.54 d= 0.28 mm. 

6. The diameter of a rod was measured several times with the following 
results : 

1.034, 1.031, 1.029, 1.032, 1.034, 1.030, 1.034, 1.033, 1.032, 1.031. 

Find the p.e. of a single measurement, the p.e. of the mean, the most 
probable diameter of the rod, its cross-sectional area, and the p.e. of this 
area. 

7. The diameter of a polished steel rod was measured ten times with 
the following results: 

0.5003, 0.5002, 0.4999, 0.4998, 0.4999, 0.5003, 0.5001, 0.5004, 0.5001, 

0.4999. 

Find the cross-sectional area and its p.e. 

8. Explain how you would decide in any given problem whether to 
use formula (6. 1) or formula (139. 1). What is the fundamental differ- 
ence between these two formulas? 
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EMPIRICAL FORMULAS 

142. Introduction. An empirical formula, or empirical equation, is one 
whose form is inferred from the results of experiment or observation and 
in which the constants are determined from experimental or observational 
data. Thus, it is known that the speed of a ship varies with the horse 
power according to the formula 

P = a + bV\ 

The constants to be determined in this formula are a and &, and for the 
purpose of determining them we should take several sets of readings of 
the speed and corresponding horse power. These sets of simultaneous 
values of V and P would, when substituted in the given formula, give 
several equations in the two unknowns a and 6. The next thing to be 
done would be to find the best values for a and 6 from the several 
equations. For the solution of this part of the problem three methods 
are available : the graphic method or method of selected points^ the method 
of averages, and the method of Least Squares. We shall now consider 
these methods in the order named and illustrate each by several examples. 

143. The Graphic Method, or Method of Selected Points. This method 
can be used whenever the given formula can be plotted as a straight line 
either directly or after a suitable transformation. The equation given 
above, for example, can be reduced to a straight-line form by putting 
y® = t, thereby reducing the equation to the form 

P = a + 

which is linear in the variables t and P. 

To apply the graphic method to this problem we plot on coordinate 
paper the corresponding values of /(= V^) and P. The plotted points 
should lie nearly on a straight line. We then draw a straight line which 
will be a good compromise for all the plotted points and pass as near 
as possible to each of them. The slope of this line will be the value of 
b and its P-intercept will be a. If the line happens to pass through two 
cof the plotted points, or through any other two points whose coordinates 
are easily determined (points at the corners of squares, for instance), 
we can substitute their coordinates in the given equation and solve the 
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two resulting equations for a and but the points so used should be as 
far apart as possible. The drawing of the best representative straight 
line is a matter of good judgment. 

This method will give fairly good results when finely divided coordinate 
paper is used, but in general it is not recommended except for obtaining 
approximate values of the constants or in cases where the results obtainable 
by the method are as accurate as the data used. 

Example 1, The electrical resistance of a copper wire varies with the 
temperature according to the equation 

a a -j- bT. 

For the purpose of determining the constants a and b the measurements 
of temperature and corresponding resistance given in the following table 
were made. Find the values of a and b. 


T 

19 1 

25 0 

30 1 

1 

36 0 

40.0 

45 1 

50.0 

R 

76.30 

^7 80 

79 75 

80 80 

82.35 

83.90 

85.10 



Temperature 

Fig. 48 


Solution, Plotting these pairs of values on a large sheet of paper and 
drawing what seems to be a good compromise line (Fig. 48), we find* that 
this line passes through the points (21,77) and (64,89). Substituting 
in the given equation the coordinates of these points, we have 
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a + 21b = 77 
a 4- 646 = 89 

436 = 12 6 = ^ = 0.2790, 

and 

a = 77 — 21 X 0.2790 = 71.14. 

Hence the required relation between R and T is 

R = 71,14 + 0.2790r . 

To see how well this formula fits the data in the table we compute the 
residuals of the several measurements. Writing 

V = 0.2790r + 71.14 — R, 

we have 

= 0.2790 X 19.1 + 71.14—76.30 = 0.16 
V2 = 0.2790 X 25.0 + 71.14 — 77.80 = 0.32 

Vji — — 0.21 

Vi = 0.39 

v, = — 0.05 
Ve = — 0.19 
V, = — 0.01 

.•. 2v = 0.40, Si’" = 0.36. 

Example 2. The data in the following table fit a formula of the type 


(1) y = ax^. 

Find the values of a and n and thence the required formula. 


X 

10 

20 

30 

40 

50 

60 

70 

80 

y 

1 06 

1 33 

1 52 

1.68 

1 81 

1.91 

2.01 

2.11 


Solution, Taking the logarithm of each side of the given equation, 
we have 

(2) log y = log a + n log x. 

Putting 

we get 


= log a. 


where a' 


y' = log y, of = log X, 
y' = log a + = a' -|- nafy 
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This is the equation of a straight line in the new variables ar' and y\ 
To plot this line the most conveniently we use logarithmic paper. 
Plotting the given points on such paper^ we find that they lie almost 


Y 



exactly on a straight line (Fig. 49). Hence we substitute in (3) the 
coordinates of the first and last of the given points and get 

log 1.06 — log a n, 
log 2.11 = log a + n log 80 ; 


or 


n + log a = 0.0253, 
1.9031n + log a = 0.3243. 
0T9031n = 0.2990^ 


71 = 0.3311. 


Also, 


log a — 0.0253 — n 

= 0,0253 — 0.3311 
= 9.6942 — 10. 

.‘. a = 0.4945. 

The required formula is therefore 

y = 0.4945 3:^ 

Example 3. Find a formula of the form 
(3) y = 
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which will fit the data in the table below. 


X 

1 

2 

3 

4 

5 

6 

7 

8 

y 

15.3 

20 5 

27.4 

36.6 

49.1 

65 6 

87.8 

117.6 


Solution. Taking the common logarithm of each side of the given 
equation, we have 

(4) log y = log h + nix log e = log h {m log e)Xy 

or 

y' = log A; + (m log e)x, where y' = log y. 

This is the equation of a straight line in the variables x and y\ To plot 
it we use semilogarithmic paper. Plotting the given values of x and y 
on semilogarithmic paper, we find that the points lie nearly on a straight 
line (Fig. 50), Drawing on a large sheet of paper what seems to be a 


Y 



Fio. 50 
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good representative line, we notice that it passes through the points (0.4, 
13) and (8.6,140). Substituting these values in (4), we have 

log 13 = log k -f- 0.43429m (0.4) = log k -f- 0.1737m, 
log 140 = log A; + 0.43429m (8.6) = log & + 3.7349m. 

Solving these equations for m and k, we get 

m = 0.2898, 
k = 11.58. 

The required equation is therefore 

y = 11.58e®-«®®*. 


Note, In logarithmic coordinate paper the origin is the point (1,1). 
Hence the equations of the axes are x = ly y = 1, Putting a; = 1 in the 
equation y = we get y = a. Hence in the straight-line graph of the 
equation y = ax" on logarithmic paper the constant a is the y -intercept. 

To find a formula for the exponent n, let (xi, yi) and (^2,^2) be any 
two pairs of corresponding values of x and y. Then from (2) 

log 2/2 = log a + n log , 
log — log g + n log x^ , 

.’. log 1/2 — log 2/1 == n(logX2 — loga^i), 

or 

(K\ _ log 1/2 — log 2/1 

^ ^ “ log 2:2 — log T, • 


The origin of coordinates in semilogarithm ic paper is the point (0, 1). 
The equation of the y-axis is therefore x = 0, and that of the x-axis is 
y = 1. Putting a; = 0 in (3), we get y = k. Hence in the straight-line 
graph of the equation y = ke^^ on semilogarithmic paper the constant k 
is the y-intercept. 

To find a formula for the ' exponent m we substitute in (4) two pairs 
of corresponding values of x and y, obtaining the two equations 


or 


log y2 = log A: + (m log c)a;2 , 
lo g yi — log ^ + (^ log - 
log 1/2 — log 3/1 = (^2 — cci) m log e, 


log 3/2 — log yi 

(xz — Xi)loge 


(log 3/2 — log yi) 


( 6 ) 


= 2.3026 


Xz — Xi 
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If the given points are so plotted that the equations of the axes are 
not as stated above, the ^-intercept will not be the value of the constant 
a or 1c. For instance, in Example 2 we plotted the point (10, 1.06) on the 
y-axis. This is really equivalent to making the substitution x = 10a;', 
so that the given equation is transformed into the equivalent equation 

y = a (10a;')" = a X 10"a;'". 

Putting a;' = 1, we get y == a X 10" = 0.4945 X 10 ® «ii = 1.06, and this 
is the actual plotted value of the y-intercept. The student should have no 
difficulty in deciding whether or not the y-intercept of the plotted straight 
line gives the true value of the coefficients a and k in any given example. 

144. The Method of Averages. The residuals of a series of plotted 
points are the vertical distances of these points from the best representative 
curve. Some of the residuals will be positive and others negative. The 
method of averages assumes that the best representative curve is that for 
which the algebraic sum of the residuals is zero. To find the unknown 
constants in an empirical formula by this method we first substitute in 
the given formula the several pairs of observed or measured values of x 
and y. We thus get as many residuals as there are pairs of observed 
values. Then we divide the residuals, or residual equations, into as many 
groups as there are constants in the assumed formula. Each group should 
contain as nearly as possible the same number of residuals. By placing 
the sum of the residuals in the first group equal to zero we get a single 
equation in the unknown constants. Placing the sum of the residuals in 
the second group equal to zero, we get a second equation in the constants, 
and so on. Since the sum of the residuals in each group is zero, the sum 
of all the residuals is necessarily zero. On solving simultaneously the 
equations obtained from the several . groups, we obtain the values of the 
unknown constants in the original formula. A few examples will make 
the method clear. 

Example 1. The data in the following table will fit a formula of the 
type 

( 1 ) y = a + ^ 2 ; + 

Find the formula. 


X 

S7.5 

84 0 

77 8 

63 7 

46 7 

36.9 

y 

292 

283 

270 

235 , 

197 j 

181 
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Solution. Substituting in (1) the several pairs of corresponding values 
of X and y, we get 


Cvi = a + 87.5b + 7656c — 292 ^ 
^ lv 2 = a + 84.0b + 7056c — 283 

(va = a + 77.8b + 6053c — 270 
= a 4- 63.7b + 4058c — 235 ^ 

Ci ;5 = a + 46.7b + 2181c— 197 
I ve = a + 36.9b + 1362c — 181 


Eesidual 

equations. 


Dividing these equations into three groups (since there are three con- 
stants to be determined), as indicated by the braces at the left, adding 
the equations of each group, and placing the sums equal to zero, we get 
the three equations 

2a + 171.5b 4- 14712c = 575 ^ 

2a + 141.5b 4- 10111c = 505 . 

2a + 83.6b 4- 3543c = 378 


Solving these three equations simultaneously for a, b, and c, we get 
a = 107.72, b = 1.7960, c = 0.0035036. 


Hence the required formula is 

y = 107.72 4- 1.7960a; + 0.0035036a;*. 

This method of averages requires no graph and can be applied to any 
formula which is linear (of the first degree) in the unknown constants 
or to any formula which is reducible to a form linear in the constants. 

Example 2. Solve Example 2, Art. 143, by the method of averages. 
Solution. Strictly speaking, the residuals are, by definition, 

= axx‘^ — , V 2 = ax 2 ^ — yz , etc. 

But if we divide these equations into groups, add, and attempt to solve 
the resulting equations for a and n, we get into trouble at once; for the 
unknown n occurs as an exponent in several terms of a sum. 

We can avoid this trouble without much loss in accuracy by proceeding 
as follows; Instead of equating to zero the sum of the residuals of the 
y^s, we equate to zero the sum of the residuals of the logarithms of the y's. 
For any residual we have from (2) of Art. 143 


v' = log a + n log X — log y. 
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Hence the several residuals are 

V, = log a + l.OOOOn — 0.0253 
v's = log a -f- l.SOlOn — 0.1239 
I v'a = log o + 1.4771n — 0.1818 
y« ^ log a 4- 1.6021n — 0.2253 

V, = log a + 1.6990n — 0.2577 
jj ^ v'« = log a + 1.7782n — 0.2810 
* «'t = log a + 1.8451n — 0.3032 
y's = log a + 1.9031n — 0.3243. 

In actual practice we do not write down these equations in this form, 
but in the form given below: 

log a 4- l.OOOOn = 0.0253 log a + 1.6990n = 0.2577 

log a 4- 1.3010n = 0.1239 log a 4- 1.7782n = 0.2810 

log a 4- 1.4771n = 0.1818 log a 4- 1.8451n = 0.3032 

log a 4- 1.6021n = 0.2253 log a 4- 1.9031n = 0.3243 

(2) 4 log a 4- 5.3802n = 0.5563. (3) 4 log o 4- 7.2254n = 1.1662. 

Solving (2) and (3) simultaneously, we get 

n = 0.3305, log a = — 0.3056 = 9.6945 — 10 a = 0.4949. 

The required formula is therefore 

y = 0.4949X®*”®. 

Note. The method of averages is the shortest and easiest method for 
finding the constants in an empirical formula, but it must not be used 
blindly. The residual equations can be grouped in several ways,* and 

* The number of possible groupings is given by the following formulas: 

a) Two groups. The number of dilferent ways in which p -f- 9 different things can 
be divided into two groups of p things and q things, respectively, is 

(P + g)! 
p!gl 

b ) Three groups. The number of different ways in which p + g + *• different 
things can be divided into three groups of p things, q things, and r things, respec- 
tively, is 

(P -f g -f ^ 

p\q\r\ 

c) Four or more groups. The number of ways in which we can divide p-|-g+»'-ha 
different things into four groups of p things, q things, r things, and s things, 
respectively, is 

(p + g -l~ ^ 

p\q\r\s\ 

And so on for any other case. For the proof of these formulas see Wentworth s 
College Alegbra, pp. 263-264; or Whitworth’s Choice and Chance, pp. 63-64. 
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each different grouping will give different values for the unknown con- 
stants, even though the algebraic sum of the residuals be zero in every 
case. The resulting formulas will thus be different, and some of them 
will fit the data much better than the others. 

There is no way to determine in advance just what grouping will give 
the best result. As a general rule the best formula is obtained by grouping 
the residual equations in consecutive order, as was done in Examples 1 
and 2. The following example will serve to clear up the matter of 
grouping. 

Example S. Find by the method of averages a formula of the type 

y = a -\- hx^ 

which will fit the following data: 


X 

5 

7 

9 

1 

12 

y 

290 

560 

1044 

1810 

2300 


Solution, The residual equations are 

Vi = a 1255 — 290 

V 2 = a 3436 — 660 

V2 = a+ 7296 — 1044 
V4 = a + 13316 — 1810 
v^ = a+ 17286 — 2300. 

The number of possible groupings of these equations is 5I/(3!2!) =10. 

The ten different groupings and the resulting formulas corresponding to 

them are given below. 

fvi 

] y = 130.87 -f 1.2570x». 

U2 

fva 

= 0.000010, = 64.066. 

] 1)2 yz= 128.86 + 1.2693X*. 

2 . , 

] = 0.000071, 2®* = 72.600. 

[®* 
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3. 


4. 


5. 


6 . 


7. 





y = 129.68 + 1.2584x». 

0.00028, 2^2 = 66.668. 

y = 158.91 + 1.2240a:®. 

^v = — 0.000017. 2v^ = 2038.694. 


y = 135.95 + 1.2510a;®. 

2v = — 0.000004, 2v" = 132.197. 


( V2 

y = 253.69 + 1.1127a;®. 

Va 2v = — 0.000001, 2v^ = 37626.548. 


Vi 

^2 y = 137.76 + 1.2489a;®. 

( t^3 

2t; = — 0.000002, 2v* = 187.328. 

Vs 

(Vi 

iv. y = 123.95 + 1.2651a;®. 

Vs 

V* 


8 . 


2v = 0.0000001, 2»* = 177.706. 
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9. 


10 . 


V2 

y = 123.84 + 1.2662a;». 

V3 

[v, 

Y,v = — 0.000002, = 181.389. 



y = 142.23 + 1.2436a:». 


Vi 

, t;3 Xv = — 0.000001. = 393.303. 

.^4 


The best formulas are those for which is and are evidently 
1, 2, 3. The poorest are 4 and 6. 

The best formula obtainable is found by the method of Least Squares 
to be 

y = 130.71 + 1.2572a:», 


for which 2^ = — 0.0000016 and 2'*^^ = 64.004. 

A carefully constructed graph, obtained by putting = u and plotting 
the straight line y = a hu on large sheet of finely squared paper, gave 

y = 125 + 1.33a;3, 

for which 2^ = 281.48, 2^^ = 25460.154. This formula obtained from 
a good graph is far inferior to nine of the ten formulas obtained by the 
method of averages. 

When the number of residual equations is large enough to allow three 
or more to each group, the method of averages can be depended upon 
to give good results. If we have only a few sets of data (readings or 
measurements) and can not easily obtain more, we should always use the 
method of Least Squares. This method gives only one formula and that 
is always the best possible one. 

Every empirical formula, however obtained, should always be tested by 
computing the residuals and seeing whether they are within allowable 
limits. 


145. The Method of Least Squares. This method says that the best 
representative curve is that for which the sum of the squares of the 
residuals is a minimum. Since the squares of the residuals are positive 
quantities, the requirement that their sum shall be as small as possible 
insures that the numerical values of the residuals will be small; and this 
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means that in the case of a series of plotted points the best representative 
curve will pass as closely as possible to all the points. Before applying 
this method to empirical formulas we shall first derive a fundamental 
rule which reduces the method to a simple procedure. 

For simplicity let us consider the formula 

(1) y = a -\-hx cx^ 

and find the values of a, h, and c which will make the graph of (1) pass as 
near as possible to each of the n points (oJi, yi), (^2, ^2),* * * {^nyVn), 
or, stated otherwise, let us find an equation of the form (1) which will 
be satisfied as nearly as possible by each of the n pairs of observed values 
{^ 2 ,y 2 ),' ■ ' {Xn,yn)- The equation will not, in general, be 
satisfied exactly by any of the n pairs. Substituting in (1) each of the n 
pairs of values in turn, we get the following residual equations : 


Vi = a + 6x1 + cxi* — , 

V 2 a — |- 6x2 0 X 2 ^ — yz y 

Vn = a-\rhXn + cx^? — yn . 

The principle of least squares says that the best values of the unknown 
constants a, 6, and c are those which make the sum of the squares of the 
residuals a minimum, or 

= Vi^ + V2^ • • + V 

must be a minimum. Hence 

2(a + + cx* — yy = (a + — yO^ + (^^ + + cxj* — yzY 

+ • • ' + (a + bxn + cx^ — ynY = f(a, 6, c) 
is to be a minimum. 

The condition that f{a,h,c) be a maximum or a minimum is that its 
partial derivatives with respect to a, 6, and c shall each be zero. We 
therefore have 

^ = 2{a -\-hxx-\- cxY — yO + 2(a + bxz + CX2* — ^2) + ' * * = 

~ = 2 (a 6x1 + — yO^i “I” “H ^^2 “1" y2)^2 ^ ‘ * ■ ■ = 

00 

= 2(a + -f- casi* — yi)xi‘ + 2(a + bxt + cx^ — y^x^ + • • • = 0. 

oc 
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Dividing through by 2 , we get the following three normal equations: 

(a + 6 xi + — 3 / 1 ) + (a + hxz + cxz* — ^ 2 ) 

“1“ * ■ ■ "i" 4" CXn^ yn) = 0, 

Xi(a + hx^ + cxi* — yi) + Xz^a + hx2 + cx^^ — 3/2) 

• . -I- Xn{a + hXn + CXn^ — ^n) = 0, 

Xx^{a + 6xi 4“ — y^) + X 2 ^{cl + 6x2 + cxj* — y^ 

+ • ■ • + Xn\a 4 - hXn 4- CXn^ Vn) = 0 . 

It will be observed that these normal equations can be written down 
immediately by applying the following 

Rule : To find the first normal equation multiply the right-hand member 
of each residual equation by the coefficient of the first unknown in that 
member, add the products thus obtained, and equate their sum to zero; 
to get the second normal equation multiply the right-hand member of 
each residual equation by the coefficient of the second unknown in that 
member, add the products so obtained, and place their sum equal to zero; 
and so on for the remaining normal equations. 

The normal equations are solved by the ordinary methods of algebra 
for solving simultaneous equations of the first degree in two or more 
unknowns. When there are several equations and the coefficients contain 
several digits, solve by the methods of Arts. 158 or 164. 

The number of normal equations is always the same as the number of 
unknown constants to be determined, whereas the number of residual 
equations is equal to the number of observations. The number of observa- 
tions must always be greater than the number of undetermined constants 
if the method of least squares is to be of any benefit in the solution. 

The rule above is applicable to any formula which is linear in the 
constants or to any formula which can be reduced to a form linear in 
the constants. 

Example 1. Find the equation of the straight line which comes nearest 
to passing through the following points: 

0 5 1 0 1.5 2.0 2 5 3 0 

0 31 0 82 1.29 1.85 2.51 3.02 

Solution, Let the equation of the line be 

y — a hx. 

Substituting in this equation the several pairs of values of x and y, we 
get the following residual equations: 
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1*1 — CL -j— 0.56 — 0.31 
V 2 = a 6 — 0.82 
^3 = a + 1.56 — 1.29 
v^ = a-\- 26 — 1.85 

= a + 2.56 — 2.51 
Vq — CL — |— 36 — 3.02 


Residual equations. 


Adding the right-hand members and equating their sum to zero, we get 
6a+ 10.56 — 9.80 = 0. 

Multiplying the right-hand member of the first residual equation by 0.5, 
the second by 1, the third by 1.5, etc., adding the products, and equating 
their sum to zero, we get 

10.5a + 22.756 — 21.945 = 0. 

Hence the normal equations are 

6a + 10.56 = 9.80 ) i 

10.5« + 32.751. = 21.945; 

Solving these by determinants, we have 



9.80 

21.945 

10.5 

22.75 

_ 222.950 — 

230.422 

_ 7.472 


6 

1 10.5 

10.5 

22.75 

““ 136.50 — 

110.25 

26.25 


6 

10.5 

9.80 

21.945 

_ 131.670 — 

■ 102.900 

__ 28.770 . 

— 

26.25 

26.25 

“ 26.25 


= — 0.285. 


- = 1.096 


= 1.10, say. 


The required equation is therefore 

y = — 0.285 + 1.10X. 

Computing the residuals by substituting the given points in this formula, 
we have 

Vi, = — 0.045, V2 = — 0.005, Vs = 0.075, 

v* = 0.065, Vs = — 0045, Ve = — 0.005. 

2v = 0.04, 2v" = 0.014. 

Example 2. Find a formula of the form 

y = a + 6a; + ca;* 
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which will fit the following data: 



Solution, Substituting in the assumed formula the corresponding values 
of X and y as given in the table, we get 

v, = a + 06 + Oc — 3.1950 
= a + 0.16 + 0.01c — 3.2299 
Va = a + 0.26 + 0.04c — 3.2532 
v^ = a + 0.36 + 0.09c — 3.2611 
v, = a + 0.46 + 0.16c — 3.2516 
Vq a — |— 0.56 — |— 0 25c — 3.2282 

VT = a + 0.66 + 0.36c — 3.1807 
Vs = a + 0.76 + 0.49c — 3.1266 
v^=za+ 0.86 + 0.64c — 3.0594 
Vio = a + 0.96 + 0.81c — 2.9759 

Applying the rule of page 453 to these equations, we get 

10a + 4.56 + 2.85c = 31.7616 I 
4;5a + 2.856 + 2.025c = 14.0896 I Normal equations. 

2.85a + 2.0256 + 1.5333c = 8.82881 J 

Solving these for a, 6, c, we find 

a = 3.1951, 

6 = 0.44254, 
c = — 0.76531. 

Hence the required equation is 

y — 3.1951 + 0.44254X — 0.76531a:^ 

If we compute the residuals by substituting in this formula the values 
of X and y given in the table, we find 

Sv =r 0.0001, 2^* = 0.0000549. 

The following example is given to illustrate how the solution of a 
problem in a routine, perfunctory manner can lead to a worthless result. 
The first computation is the perfunctory one in which the work is done 
in a routine, careless manner. The second computation improves on the 
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first by preventing errors of computation in the evaluation of the deter- 
minants. The third computation prevents errors of computation from 
the very beginning. 

Example S, The indicated horse power, /, required to drive a ship of 
displacement D tons at a ten-knot speed is given by the following data. 
Find a formula of the form I = al> which will fit the data. 


D 

1720 

2300 

3200 

4100 

I 

655 

789 

1000 

1164 


Solution. We have 


I = aD^. 

log 1 = log a + n log D. 


The residuals are really 


Vi = — Ixy V 2 = aDz^ — 12 y etc.. 


but we save a great deal of labor and commit very little error by writing 


( 4 ) 


' v'l = log a + n log Di — log 7i , 
- v '2 = log a + n log D 2 — log 72, 
etc.. 


and making the sum of the squares of the v'^s a minimum. 


(a). Perfunctory Computation. Substituting in these equations the 
corresponding values of D and /, we get 


v\ z= log a -f 3.236n — 2.816 ' 
v\ = log a + 3.362n — 2.897 
v\ z= log a -f 3.505n — 3.000 
v\ = log a + 3.613n — 3.066 


Residual equations. 


Since these equations are linear in the constants n and log a, we c:m 
apply the rule stated on page 453. Adding the right-hand members and 
equating their sum to zero, we find the first normal equation to be 


4 log a + 13.716n = 11.779. 

Multiplying the right-hand member of the first residual equation by 
3.236, the second by 3.362, etc., addinj the products, and equating their 
sum to zero, we get 

13.716 log a + 47.11ft = 40.446 
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for the second normal equation. Rounding off these numbers to four 
figures, we have 


47.11n + 13.72 loga=: 
13.72n + 4 log 


a = 40.44 ) 
a =: 11.78 \ 


Normal equations. 


Solving these equations by determinants, we have 


loga = 



40.44 

13.72 


11.78 

4 


47.11 

13.72 


13.72 

4 


47.11 

40.44 


13.72 

11.78 


161.76 — 161.62 


188.44 — 188.24 0.20 


554.96 — 554.84 0.12 


= ^ = 0 . 700 , 


0.20 


0.20 


= 0.600. 


0.20 
.*. a = 3.981. 

The resulting formula is therefore 

I = 

Computing the residuals by substituting the data in this formula, we get 
Vi= — 77, 1^2 = — 108, t;3 = — 131, v, = _ 182. 


Hence 


= 67,878. 


The formula which we have found is evidently so poor as to be worth- 
less; for the residuals are large, all of the same sign, and the sum of their 
squares is exceedingly large. 

The results would have been far worse if we had rounded off to four 
figures the products obtained in evaluating the determinants, for in that 
case we would have had 


n = 

loga = 


161.8 — 161.6 
188.4 — 188.2 

555.0 — 554.8 

0.2 


0.2 

0.2 

0.2 


= 1 

= 1 . 


a = 10. 


Hence the formula would have been 

/ = 10Z>, 

which is totally worthless in this case. 
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The poor result obtained above is due primarily to the fact that in the 
process of solving the normal equations three of the most important 
significant figures disappeared hy suhtraciion (see Art. 7) ; for n and log a 
were determined from the simple fractions 0.14/0.20 and 0.12/0.20, 
respectively, in each of which the second figure in both numerator and 
denominator is doubtful. This loss of significant figures did not seriously 
affect n, but in the case of a the effect was disastrous. The reason for 
the greater effect on a is this : An error c in log N will cause an error 
2.3026 Ne in the antilog (Art. 7). 


(b). Improved Computation. Treating the elements of the deter- 
minants as exact numbers and retaining all the figures in the products, 
we have 


n = 


loga == 


1 40.44 

13.72 

1 11.78 

4 

1 47.ir 

13.72 

1 13.72 

4 

47.11 

40.44 

13.72 

11.78 


0.2016 


1 61,76 — IjGl. 6216 _ 0.1384 __ 
188.44 — 188.2384 0.2016 “ 


5r)4.95r)8 — 554.8368 __ 0.1190 ^ 

0.2016 0.2016 


whence 


a = 3.893. 


The resulting formula is therefore 

1 =Z 3.893D^-^^^\ 


The residuals in this case are 

V, = 7.16, V 2 — — ^ .88, IK =z 7.87, = — 12.1 ; and 

= 263.1. 


(c). Accurate Solution. 


One way io get the required constants correct 'to four significant figures 
in this example is to solve the problem anew and carry all computations 
to eight significant figures, so that we shall have five left alter the first 
three disappear by subtraction. We therefore make a new computation, 
using 7-place logs. The results are as follows: 
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161.773154 — 161.554945 0,21821 
188.43257 —188.10644 0.32613 

, 554.89958 — 554.68739 0.21219 

loff a = = = 0.65063 

^ 0.32613 0.32613 

. . it — 4.4 1 33 — 4.4 i 3, sny. 


Hence the final formula is 


7 = 4.473 

The residuals are found to be 

rj = — 1.1, r._. = 5.2, — — 9.4, ^4 = 5.3; 


and therefore 

= 0.0, 2^*- == 144.7. 

Note, This example serves to bring out an important point which must 
be kept in mind when determining the constants in empirical formulas. 
The point is this: The data used in determining the constants should be 
treated as exact numbers, and the computer must be careful about rounding 
off and dropping seemingly superfluous digits at any stage of the com- 
putation. The final values of the constants should be given to as many 
significant figures as are given in the original data. 

When it happens that some of the most important significant figures 
disappear by substraction, as in the example above, the computation must 
be carried through with enough significant figures at all stages to give a 
reliable result. As a general rule it may be stated that if the constants 
are desired to m significant figures and if a preliminary calculation shows 
that the first p figures will disappear by subtraction, the calculation must be 
performed with m + p + 1 significant figures throughout from beginning 
to end. 

In the solution of systems of linear equations the occasional loss of the 
leading significant figures by subtraction cannot be prevented, but the 
harmful effect of such loss can be lessened by preventing subsequent errors 
of computation. 

146. Weighted Residuals. It sometimes happens that the residuals are 
not all of the same weight. This is the case when we use the residuals 
of a function of y instead of those of y itself. In Ex. 2, Art. 143, and 
Ex. 3, Art. 145, for example, we found it necessary to use the residuals 
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of log y instead of those of y. In these cases the residuals were no longer 
of equal weight, as we shall now show. 

Using the notation of Art. 139, let 

0 = /(y). 

Then 

Substituting this in (139. 1), we get 

R = ny)r, 

where r denotes the p. b. of y and R the p. b. of /(y). Hence 

Since the same relations hold between residuals as between probable 
errors, we may write 

R V 


where v and V denote the residuals of y and /(y), respectively. Hence 

Denoting by Wy and Wf the weights of y and /(y), respectively, we hav< 
from (136. 2) 

Wf ^ ^ 1 

” [r{y)y * 

( 148 . 1 ) .. 

Now if f{y) = login y = M log, y, where M = 0.43429, we have 


Hence from ( 146. 1 ) 


n.)=f. 


and if all the y’s are of equal weight, then »* = 1 and we have 


(146. 2) 
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We shall next derive the fundamental rule for writing down the normal 
equations when the residuals have different weights. 

By Art. 126 the best result obtainable from measurements of unequal 
weiglit is that for which the sum of the weighted squares of the residuals 
is a minimum. Hence we must have 

4“ ^^ 2 ^ 2 ^ + ‘ * ‘ + a minimum. 

In the case of the equation y =. a hx cx^ (Art. 145) we therefore have 

Wi (a + hxi 4 “ — ViY ^2(a + ^^2 4 " ^^2^ — ^2)^ 4 " ‘ * s- minimum. 

Calling this expression f{a,h,c), taking the partial derivatives with 
repect to a, 6, c in turn, and equating each to zero, we have 

= 2^1 (0+ fell + cxi= — yi) + 2w2(a + 6 ^2 -f 0x2“ — yj) 4 - ■ • ■= 0 , 

-:^ = 2wiXj(a-j-bXi + cXi^ — yi) 2wnXn(a hx. cxn^ — ^ 2 ) 4 " * • • = 0 , 
CO 

=z 2 wiXi^(a + bxi 4 - — t/i) + 2w2X2^(a + bxz + cxz^ — 3/2) 4 “ ‘ ‘ ’ = 0 , 

oc 

Hence on dividing through by 2 we get 

Wi{a + bxi + cxi^ — yi) 4 - W2(a 4 - 6 x 2 4 - — 1 / 2 ) 

4 - ’ • ■ 4 - 4 - bXn 4 CXn- — t/^) = 0 

WiXi(a 4 4 — yi) 4 4 ^^2 4 ^^ 2 ^ — ^ 2 ) 

4 • • • 4 WnXn(a 4 bXn 4 — Vn) = 0 

WiXi^a 4 4 — yi) 4 'W2X2\a 4 ^^2 4 — ^ 2 ) 

4 • • • 4 WnXn\a 4 bXn 4 CXn^ — yn) = 0 

In the case of weighted residuals we can therefore write down the 
normal equations according to the following 

Rule\ To get the first normal equation multiply the right-hand side 
of each residual equation by its weight and by the coefficient of the first 
unknown in that equation, add the products thus obtained, and equate 
their sum to zero; to find the second normal equation multiply the right- 
hand member of each residual equation by its weight and by the coefficient 
of the second unknown in that member, add the products, and equate 
their sum to zero; and so on for the others. 

We shall now work Ex. 3 of the preceding article by the method of 
weights. By (146.2) the weights of the residuals are 

and but since the factor 1/M^ will divide out in the normal 


Weighted 
> normal 
equations. 
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equations we do not write it down at all. The solution given below should 
be self-expanatory. 

I = aD^. 


log I = log a n log D. 


D 

1720 

2300 

3200 

4100 

I 

655 

789 

1000 

1164 

7* 

429025 

622521 

1000000 

1354896 


Weights 

= log a + 3.2355284n — 2.8162413 429025 ' 

V 2 = log a + 3.361 7278n — 2.8970770 622521 Residual 

Vs = log a + 3.5051 500n — 3.0000000 1000000 ' equations. 

= log a + 3.6127839n — 3.0659530 1354896 J 

Now applying the rule for writing down the weighted normal equations, 
we find them to be 

11880965.2n + 3406442 log a = 10165776.6 ) Weighted normal 
41497013.1n + 11880965.2 log a = 35495260.6 j equations. 

Solving these by determinants, we find 

n = 0.6671, a = 4.546. 

The required formula is therefore 

7 — 4 . 54611 ^ 

The residuals are found to be 

Vi= — 0.3, V2 = 5.8, Vs = — 9.4, = 4.8. 

2^ = 0.9, = 145.1. 

Here the values of 2^' slightly larger than in the unweighted 

previous solution, but the lack of iinpro\«*ineiit is not the iault of the 
weighting method. It is due to the singular nature of the example tieated. 
After applying this weighting method to several simple examples of different 
types and comparing the results with those obtained by ignoring differences 
in weight, the author is of the opinion that ordinarily it is not worth 
while to bother about the weights of the residuals'; but problems sometimes 
arise in which the weights must be considered.*^ 

* For a striking example of the effect of weighting in some problems see an im- 
portant paper by C. E. Van Orstrand: “ On the Empirical Representation of Certain 
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Remark, Since the weights in the preceding example are approximately 
as the numbers 43, 62, 100, and 135, the student may wonder why it. is 
not sufficient to multiply the residuals by these smaller numbers instead 
of by the actual weights 429025, 622521, etc. The answer is that if we 
did this the corresponding products would be true to only two or three 
significant figures and these would disappear in this problem by subtraction 
in solving the normal equations, so that the results found would be very 
uncertain. We can state as a general rule that the number of significant 
figures used in the weights must not be less than the number of significant 
figures which are to be retained throughout the computation, unless the 
exact values of the weights happen to contain fewer figures than the 
number retained throughout the computation. 


147. Non-Linear Formulas. — The General Case. Not all empirical 
formulas can be handled by the methods thus far considered. For example, 
the relation between the pressure p and temperature t of saturated steam 
can be expressed by a formula of the type 


where a, 6, c, are unknown constants. These constants do not enter the 
formula linearly, and no transformation of the formula will give a linear 
relation among them. Consequently they can not be determined by the 
methods previously given. We are now going to develop a method which 
will apply to any type of formula, however complicated it may be. 

Let us consider a formula involving two variables, x and y, and three 
undetermined constants, a, 6, c. Such a formula may be written in the 
symbolic form 

(1) y = f{x,a,b,c). 


Let ao, ioy Co be approximate values of a, 5, c, obtained from a graph 
or by any other means, and let a, /?, y denote corrections which are to be 
applied to ao, bo, Cq, respectively, so that 


(^) 

Then 


^ a = Uo + a, 
H h = bo P, 
c = Co + y. 


( 3 ) 


y' = /(x, ao, 6o, Co) 


Production Curves,” Journal of the Washington Academy of Sciences, Vol. 15 (1925), 
No. 2. 
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will be a function whose graph approximates the graph (1) more or 
less closely. The values of this approximating function corresponding to 
3/i> will be 

= /(^i> &o> Co), 

^ y 2 = /(^2> dO) ^0, Co), 

y'n = fiXn,aoyho,Co). 

If we take (1) to be the best or moat probable function and its graph 
to be the best representative curve, then the residuals will be 


(5) 


Vi^fixi,a,h,c) —yi 
V2 = f(x2, a, h, c) —y2 


Vn = f{Xn,a,h,c)—yny 


where yi, ^ 2 , ‘ * ‘ yn are the observed y’s corresponding io.Xi,X 2 ,‘ * * , 

respectively. Substituting in (5) the values of a,h,c as given by (2). 
we have for the first residual 


Vi = f{Xiy do + a, 6o + A Co f y) —yiy 
or 

(6) Vi + yi = f(Xi, do + d,bo + Py Co + y)* 

Considering the right-hand member of (6) as a function of a, 6, c and 
expanding it by Taylor’s theorem for a function of several variables, we 
have 


(7) 1^1 -f- yi ^oy ^Oy Co) 

4- terms involving higher powers and products of a, P, y. 


where (0/i/9a)o means 



CL — do 

6 = l>„ 

h = Co 


Then since y'l = /(®i> &o, Co)> C^) becomes 


+ yi — /i + * ),+ ^ ^ 
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or 


Let 


= * (Ir),+ ^ (^)o+ ^ (^).+ • 


ri=yr — Vi, r2 = y2 — yz 
Then the residuals become 


• rn = y'n — yn ■ 


( 147 . 1 ) 


’’■=‘‘(^).+^ (!').+’' (If), 


+ r, 

+ 


+ 


Kesidual 

equations. 


These equations are linear (of the first degree) in the corrections a, /3, y, 
and we may therefore deal with the problem from this point onward 
either by the method of averages or by the method of least squares. If we 
use the latter method, we write down the normal equations by the rule 
stated on page 453. 

The quantities ri, r 2 , • • • rn are the residuals for the approximation 
curve y' = f(x, ao) boy Co) , since they are the differences between the 
observed ordinates and the ordinates to this curve. 

We shall now apply this general method to two examf)les. 

Example 1. Find a formula of the form 


y — mx + b 


which will fit the following data: 


X j 

27 1 

33 

40 

55 

68 

y 

109 9 

112.0 

114 7 

120 1 

125.0 


Solution. When these values are plotted on ordinary coordinate paper, 
the points are found to lie nearly on a straight line (Fig. 51). The line 
which seems (to the eye) to fit them best has a slope of 0.37 and a 
y-intercept of 99.7. Hence we take 

mo = 0.37, bo = 99.7. 

The approximation curve is therefore the line 

y' = 0.37x + 99.7. 
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Substituting in this equation the observed values of x, we get 

y\ = 0.37 X 27 -f 99.7 = 109.7, 
y'j = 0.37 X 33 + 99.7 = 111.9, 

= 114.7, y'4 = 120.0, j/% = 124.9. 

Hence 

n = 109.7 — 109.9 = — 0.2, 

= 111.9 — 112.0 = — 0.1, 

rj = 0.0, r 4 = — 0.1, r 5 = — 0.1. 


Y 





d})~ dh 06 96 ■ 


and 
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Substituting in (147. 1) these values of the /s and partial derivatives, 
we get 

i;i = 27a + i8 — 0.2 ' 

„, = 33a + ^-0.1 
Vs = 40a 4- /3 + 0.0 I 
■,. = 55. + ^.-0.1 

Vs — 68® -j- — 0.1 


We shall complete the problem by finding the best values of a and by 
the method of least squares. Forming the normal equations according 
to the rule on page 453, we get 


11068® + 223/3 = 
223® + 6)3 = 


= 21.0 ) 

= 0.5 \ 


Normal 

equations. 


Solving these for ® and )3, we find 


a zz: — 0.0012, = 0.152. 


Hence 


m = 0.37 — 0.0012 = 0.3688, 
b 1= 99.7 + 0.15 = 99.85. 

The required formula is therefore 

. y — 0.3688a: + 99.85. 

Example 2, Find more accurate values for the constants a, 6, c, in 
the formula 

given the approximate values 

ao = 4.53, bo = 7.45, Co = 234.7. 

Solution, For the partial derivatives {dp/da)o, (9p/3&)o^ (9p/9c)o we 
have 

(I) = ( 10 )M/c».., (I) 

/9p\ 

- /-I A\ . ^0^ 1 -in 




log, 10 

(Co+0* ® 


and 


p'l = p's = etc.; 

Ti = p'l — pi, Ts = p's — Ps , etc. 
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In the following table are given the observed values of t and p, the 
corresponding values of the partial derivatives, and the corresponding 


No. 

r C 

P 

o 


(S). 

r 

Group 

1 



0.672 


+0 005 

+0 095 


2 



' 0.763 


+0.005 

+0 007 


3 

0.00 

4.52 



0 000 

+0 005 


4 

8 01 

7.93 

1 761 


-0 018 

-1-0 049 

I 

5 

11 98 

9 88 


1 165 I 

-0 035 

+0 541 


6 

16-82 

13.52 

3.149 

2.196 

-0.064 

+0 746 


7 

23.85 

22.24 

4 867 

4 681 

-0.136 

-0 194 


8 

35.95 

43.96 

9.763 

13 523 

-0.373 

+0.265 


9 

44.90 

71 20 

15.717 

26 326 

-0.726 

-0 002 


10 

52 12 

101 40 

22 583 

42 806 

-1 112 

+0 903 


11 

58.68 

139.72 

30.910 

64.490 

-1.636 1 

+0.893 

II 

12 

74.47 

281.55 

62.300 

156 520 

-3 723 1 

+0 649 1 


13 

78.83 

330 58 

73 152 

190 924 

-4 543 1 

+ 1 248 


14 

82.25 

387.56 

85 765 

232.136 

-5 455 

+ 1 365 


15 

86.21 

453.31 

100 319 

281 098 

-6.528 

+3 807 


16 

91.34 

552.20 

122.213 

357.103 

-8 160 

+0.592 


17 

93.66 

602.53 

133.354 

396.752 

-9.003 

+2.314 


18 

99.39 

743.49 

164.564 

510.637 

-11.381 

+ 1.916 

III 

19 

100.87 

784.07 

173 547 

544 065 

-12.079 i 

+6.439 


20 

104.64 

895.83 

1 198.293 

637.758 

-13.999 1 

-3.435 



Denoting the corrections to a, h, c by a, j8, y, respectively, and sub- 
stituting in (147. 1) the values of the r’s and partial derivatives given 
in the table, we get 20 residual equations for determining a, y. In this 
problem we are going to use the method of averages; so it is not necessary 
to write down the residual equations. We simply divide the coefficients 
into three groups, as indicated in the table, and add the coefficients in each 
group. We thus get the following three equations : 

' 14.512«-t- 8.362]3— 0.243y,= — 1.249, 

. 300.190a + 726.725j3 — 17.668V = — 5.321, 

892.290a + 2727.413j8 — Gl.lSOy = — 11.633. 

Solving these equations for a, P, y, we get 


a = — 0.131, P = — 0.0603, y = — 4.437, 
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80 that the corrected values of the constants are 


a= 4.53 — 0.131 = 4.399, 
h = 7.45 — 0.0603 = 7.390, 

c = 234.70 — 4.44 = 230.26. 


The final equation is therefore 


p = 4.399(10)’®®°‘/^28o.2e+n, 


148. Determination of the Constants when Both Variables are Sub- 
ject to Error. In Arts. 144-147 it was tacitly assumed that the given 
values of the independent variable were absolutely correct and free from 
dll error; the values of the function alone were supposed to be subject 
to error. This assumption is legitimate in most cases, for it is usually 
possible and practicable to obtain the values of one variable more 
accurately than the other. 

If both variables are subject to errors of the same order of magnitude, 
the problem of finding the best values of the empirical constants is more 
complicated except in those cases in which the data can be plotted as a 
straight-line graph, either directly or after a suitable change of one or 
both variables. In the present article we shall treat only the simple case 
in which both variables are of equal weight. This is sufficient for most’ 
problems; for, as was seen in Art. 146, it is not often necessary to take 
account of differences in weight. 

Let us consider n pairs of values {x 2 ,y 2 ),’ * * (^n,yn), and 

let these be plotted as points on a straight-line graph. The line which 
best fits these points will evidently be that for which the sum of the 
squares of the perpendicular distances from the points to it is a minimum. 
The equation of any straight line may be written in the form 


( 1 ) 


ax -j- by 1 = Oy 


this symmetrical form being used because both x and y are equally subject 
to error. The perpendicular distance from any point (a^, y') to the line 
(1) is given by the formula 


Va* + 6 


The sum of the squares of the perpendicular distances from the points 
(® 2 >y 2 )> ®tc. to the line (1) is therefore 

(3) F(a,6) + 

+ (oxj + 6y2 + 1)* + • • • + <«*» + + !)*]• 
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Since this is to be a minimum, its partial derivatives with respect to a 
and b must each be zero. 

Taking the partial derivative of (3) with respect to a, we have 

^ “ (a* 4- 62)2 L(^^i + + 1)* + (aaJz + ^^2 + 1)^ 

+ • • -[“ (^n + byn + 1)^] 

2 

“I" ^2 + 1) + X2{aX2 + ^^2 + 1) 

+ • • • + Xn{aXn + byn + 1)]. 

Expanding the terms within the brackets, reducing to a common denomi- 
nator, and collecting terms, we get 

2 

^ +■ 

+ a5*(2x* — 2y*) — ^ab 2y — an]. 

Likewise, by symmetry, 

2 

If = (a» + ^)- 

+ o*l»(2y* — 2®*) — Zab 2® — &«]. 

Multiplying (4) by a, (5) by 6, adding the results, and simplifying, 
we get 

(®) •ii-+‘0 r=-?+F[“ 2 *+»a+»]- 

But since dF/da = 0 and dF/db = 0 for a minimum, (6) reduces to 

a ^x + 6 + n = 0, 

or 

(148.1) .(f)+)(|') + l = o, 

which shows that equation (1) is satisfied by the values 

»=(?)='■ ’=(?)=« 

In otheT words, the best representative line always passes through the 
centroid of the given points. 

Since dF/da and dF/db must be zero for a minimum, we have from 
(4) and (6), respectively. 
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( 148 . 2 ) h{h^ — a^)^xy+ — a^)^x — 2al 

+ a&^(2a;* — 2y*) — an = 0, 

( 148 . 3 ) a (a* — h^)^xy + (a* — 6^)2y — 2a6 2^ 

— a*6 (2ic* — 2y*) — &n = 0, 

Problems of the type treated in this article are to be solved by means 
of formulas (148.1) and (148.2) or (148.1) and (148.3), always using 
(148. 1) first. We shall apply this method to Example 1 of Art 145. 

Example, 


X 

y 

xy 

X* 

2/* 

0.5 

0.31 

0.155 

0.25 

0.0961 

1.0 

0.82 


1 00 

0.6724 

1.5 

1.29 

1.935 

2.25 

1.6641 

2.0 

1.85 


4.00 

3.4225 

2.5 

2.51 

6.275 

6.25 

6.3001 

3.0 

3.02 

9.060 

9.00 

9.1204 

Sums 10 5 

9.80 

21.945 

22 75 

21.2756 


To facilitate the computation, the several known quantities are arranged 
in tabular form as shown above. 

Since 

Sy ^ 9.80 ^ 4.90 

n 6 ’ n 6 3 ^ 

we have by (148. 1) 

4 90 

1.75a + -^ 6 +.1 = 0, 

or 

, 5.25a + 3 



Substituting this value of 6 in (148. 3) and reducing, we get 
6.7187a’ + 23.45480’ + 6.165a = 0. 

Solving for a, we find 

a — 0, — 3.8191, — 0.28227. 

The corresponding values of b are found from the equation 
6 = — (5.250 + 3)/4.9 to be 

6 = — 0.61224, 3.4796, —0.30981. 
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Since the slope of the line ( 1 ) is — a/6, it is obvious that the values 
® = — 3.8191, 6 = 3.4796 are the only ones which will fit the data of 
this example. The required line is therefore 

— 3.81912; 4- 3.47961/ + 1 0, 

or 

3.819a; — 3.480y = 1, 

or 

y = — 0.2874 + 1.0972;. 

This last equation agrees closely with that found by the ordinary method 
in Art. 145. 

If we compute the sum of the squares of the perpendicular distances 
from the several points to this line, we find 

= 0.00618. 

For the line found in Ex. 1, Art. 145, we find 

= 0.00619 ; 

the two results are thus practically identical. 

Remark, The reader will observe that the determination of the best 
representative line by the method of the present article involves but little, 
if any, more labor than the ordinary method of Art. 145. 

149. Finding the Best Type of Formula. There exists no general 
method for finding the best type of formula to fit any given set of data. 
Probably the best one can do is to proceed as follows: 

1. Plot the data on rectangular coordinate paper, taking care to choose 
the proper scales along the two axes so as to make the graph show up to 
the best advantage. 

2. If the graph is a straight line, or nearly so, assume a formula of 
the type 

y — a hx. 


3. If the graph is not a straight line but is a fairly smooth curve 
without sharp turns or bends, it is likely that the data can be fitted by 
some one of the following formulas: 




Remarks and Suggestions. 

(a) 

% 

y = a bx + cx^ + dx^. 

Linear in the constants. 

(b) 

, b 

y = <^+x 

Linear in constants. Put 1/2; = ^ 
to plot. 
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Remarks and Suggestions, 


(c) 

1 1 IT. 

y = — 7 -^ y or — = a -h oa;. 

^ a-\-bx y ^ 

Put 1/y = u and plot the straight 



line u 7 =z a bx. 


(d) 

y2 z= a + 6a; -f- cx^ + 

Linear in constants. 


(e) 

II 

or log y = log a “1- a; log 6. 


(f) 

y = ae^^y 

or log y = log u + 6a; log e. 


(g) 

log y = a-\-bx cx^. 

Linear in constants. 


(h) 

x 

^ a -f- 6a; + ca;^ ^ 



or 





— z=i a bx cx^. 

y 

Linear in constants. 


(i) 

y = ax^y 

or log y = log a + n log x. 


(j) 

y = ax^ + 

Use general method of Art. 147. 

(k) 

y = ae**® + 

« c< €t a u 

it 

(1) 


U U €( €( U 

it 

(m) 

y = ae^^ + ce^. 

t6 Ct €C it it 

it 

(n) 

y z=. ax^ -j- 6a;”. 

« cc it it it 

it 

4. 

Ab aids in determining which of the formulas (a)-(n) to use in 

any 


given problem, the following suggestions are offered: 

(a) If the observed data give a straight-line graph when plotted on 
logarithmic paper, use the formula 

y = ax^. 


(b) If the data give a straight line when plotted on semilogarithmic 
paper, the proper formula is 

y ae^^y or y = ab^, 

(c) If the points (1/a;, y) or {x, 1/y) lie on a straight line when plotted 
on ordinary coordinate paper, the proper formula is y a h/x in the 
first case and y = l/(a -[- bx) or 1/y = a -j- bx in the second case. 

5. The polynomial formula 

y = a+bx-\-cx^-\-dx^-\-' • * + 53 ;" 

can be used to fit any set of data by taking a sufficient number of terms. 
The requisite number of terms is given by the following 
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Theorem: If the values of x are in arithmetic progression {equidistant) 
and the nth differences of the y's are constant j the last term in the required 
polynomial is 

This theorem is simply a corollary of the theorem proved in Art. 19. 

For example^ the third differences in the following data are nearly 
constant; so the required polynomial is 

y = a cx^ + 


X 

y 

Aiy 

Aai/ 

AsJ/ 

0 

0 




0.1 

0.212 

0.212 



0.2 

0.463 

0.251 

0.039 


0.3 

0.772 

0.309 

0.058 

0.019 

0.4 

1 . 153 i 

0.381 

0.072 

0.014 

0.5 

1.625 

0.472 

0.091 

0.019 

0.6 

2.207 

0.582 

0.110 

0.019 

0.7 

2.917 

0.710 

0 128 

0.018 

0.8 

3.776 

0.859 

0.149 

0.021 

0.9 

4.798 

1.022 

0.163 

0.014 

1.0 

6 001 

1.203 

0.181 

0 018 


This theorem applies only when the x^s are taken at equal intervals 
apart. It rarely pays to take more than three or four terms in a poly- 
nomial formula, on account of the labor involved in determining the 
constants. 


149a. Smoothing of Observational and Experimental Data. Some- 
times it may be inconvenient or practically impossible to obtain an 
empirical formula to represent a set of observations or measurements. In 
such cases the observations or measurements should be plotted on squared 
coordinate paper as usual. Then if it is known that the function under 
consideration is continuous, or if the plotted points seem to follow some 
law, a smooth curve should be drawn which will be a good compromise 
for all the points but not necessarily passing through any of them. 
Ordinates to this curve can then be measured at any point on the hori- 
zontal axis. 

If the observations or measurements have been made for equidistant 
values of the independent variable, a better graph can be obtained by 
first correcting or smoothing the observations before plotting them. Prob- 



490 


EMPIRICAL FORMULAS 


[Chap. XVI 


ably the simplest and easiest method of smoothing is that due to Carl 
Runge and will now be explained. 

Case I. Straight-line graphs and graphs with small curvature. When 
the plotted points seem to lie approximately on a straight line or on a 
curve of such small curvature that any three consecutive points lie approxi- 
mately on a straight line, we correct the ordinate of the middle point of 
the three by replacing the graph of the function over the interval Xi-{ to 
Xui by a straight line. 

Let y denote the ordinate to the approximating line, let h = Xi — Xi-i 
= — ^i, and let u be a new variable with origin at Xi such that 


Then u = — 1, 0, 1 when x = Xi^i, Xi, x^i. 

The equation of the approximating line may be written 

(2) yz=ao + aiU. 

The residuals for the line are then y — y or ao + aiU — y, and in order 
that the line fit the daiii as closely as possible in the interval x^-i to Xi^i 
the sum of the squares of the residuals in this interval must be a minimum. 


Hence 


2 (flo + aiu — y)2 
-1 

is to be a minimum. Then by Art. 145 we have 

^2 + — y)* = 2 2 (ao + Oi« — y) =0 

OUq «1 _1 

0 ^ ^ 

5— 2 (ao + ai« — y)* = 2 2 (a© + OiM — y)« = 0. 

OUi .1 >1 

From the first of the above equations we get 


Uq — Ui — yi_i + ^0 — y< + "f" ^1 — yi+i — 0, 


from which 


or 

( 3 ) 


flo 


Vi-i + yi + 

3 


yi = 


Vir-i 

3 


The corrected ordinate at x^ is thus the mean of the ordinate at Xi and 
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the two adjacent ordinates. Since we are interested only in yi, we make 
no use of the second of the above minimum equations. 

On adding and subtracting yi in the right-hand member of (3), we get 

or 

(4) = by Art. 16. 

This equation is more convenient for use than (3). 

Case II. Graphs with large curvature. When the curvature of the 
graph is so large that the graph cannot be approximated by a straight 
line in a given interval, we replace the graph by a vertical parabola passing 
through five consecutive points whose abscissas are ^i-i, Xi, Xui, Xu 2 - 
Using a new variable u with origin at Xi as in Case I, we may write the 
equation of the parabola in the form 

y = ao + atU + azU^. 

Then u = — 2, — 1, 0, 1 , 2 when x = Xi -29 

The residuals are ao + — y, and in order that the parabola 

fit the data as closely as possible, 

2 (tto + aiW + azU*)* 

-2 

must be a minimum. Equating to zero the partial derivatives of this with 
respect to Oo? o> 2 y w® get 

2 

2 (ao + UiW + azW^ — y) =0 

-2 

2 

2 («o + + azu^ — y)u = 0 

-2 

2 

2 (ao + aiM + ttaU* — y)u* = 0, 


5<iq fli 2 ^ "4” ^2 X — 2 y 
-2 -2 ”2 

2 2 2 2 

ao2M + ai2«‘‘ + »2 2«* = 2«y 
-2 -2 -2 -2 

oo 2 M* + at i «* + «* 2 «* = 2 «*y- 

Zi -2 -2 -2 
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Since 2 ^* = 10, 2 ^* = 34, and 2^^ = 0, 2^^* = 0^ the above equations 
-2 -2 -2 -2 

reduce to 

5ao 4- lOua = 1/1^2 + yi-i + yi + yul + y*^2 
lOfli = — ^yi^2 — yi~i 4" yi+i 4“ ^yu2 
lOao + 34a2 = 4yi_2 + yi-i + yui 4" 4y*^2- 

Since we are interested only in a©) we eliminate ^2 between the first and 
third of these equations and thereby obtain 

— 3yi_2 + 4“ ^^yi 4" — 33/4+2 

a._ gg . 

Now adding and subtracting yi in the right-hand member, we get 

3 

ao = 3 /i — ^ {yi^2 — 4yi-i + 63 /* — 4yui + yuz) 

= yi — ^ by Art. 16. 


Hence we have 

3 

( 6 ) yi = yi—^^*yi-2 

as the corrected ordinate at the point Xi, 

Formulas (4) and (5) are the smoothing formulas for the two cases 
considered. They may be applied as many times as necessary, or until 
the corrections become negligible in comparison with the y’s. 

It is to be noted that (4) will not correct the first and last observations 
of a set and that (5) will not correct the first two and last two observations. 

Extensive tables of smoothing formulas of the type herein considered 
can be found in Whittaker and Eobinson’s Calculus of Observations, pp. 
295-296 (1924 edition). 


Example 1. When the following data are plotted on squared paper, 
the plotted points are seen to lie approximately on a curve of small 
curvature. Hence the y’s can be smoothed by formula (4). Two applica- 
tions of the formula are made for purposes of illustration, the results of 
the first and second corrections being denoted by y'c and y"®, respectively. 




It will be seen from the above table that the corrections are much 
smaller in the second application of the smoothing formula. This is 
generally the case. 
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Example 2, When the observations on p. 495 are plotted on squared 
paper, they are seen to lie approximately on a curve of considerable curva- 
ture. Hence we smooth them by formula (5). We make two applications 
of the formula, as before. 

The corrections in this case are seen to be much smaller in the second 
application of the smoothing formula. 


Exercise 1. The following points lie approximately on a straight line. 
Smooth the y’s by two applications of formula (4) and draw the line. 


z 

1 

2 

3 

4 

6 

6 

7 

8 

9 

10 

11 

12 

13 

14 

16 

16 

17 

18 

10 

20 

y 

1.8 

2.6 

3.6 

3.8 

4.3 

6.1 

6.6 

6.6 

6.8 

7.6 

8.1 

8.6 

0.6 

0.8 

10.6 

11.1 

11.7 

12.6 

12.0 

13.7 


Exercise 2. Smooth the in the following set by three applications 
of formula (5) : 
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EXERCISES XVI 

1. Find by the method of averages a formula of the form y = ox" 
which will fit the following data; 


X 

273 

283 

288 

293 

313 

333 

353 

373 

y 

29.4 

33 3 

35.2 

37.2 

45.8 

55.2 

65.6 

77.3 


2. Plot on logarithmic paper the data of the above example and find 
a and n graphically or from selected points. 

3. Find by the method of least squares a formula of the form 
y = a + which will fit the following data : 



19 

25 

31 

38 

44 

V 

1900 

3230 

4900 

7330 

9780 


4. The data in the following table can be fitted by a formula of the 
type y = ax”. Find the formula by the method of averages. 


X 

53.92 

26 36 

14,00 

6.992 

4.280 

2.748 

1.853 

y 

6 86 

14.70 

28.83 

60.40 

101 9 

163.3 

250.3 


5. The data given below can be fitted by an exponential formula of 
the type y = ae^^. Plot the data on semilogarithmic paper and find 
values for a and h. 


X 

2 


8 

11 

14 

17 

27 

31 

35 

44 

y 

94 8 

89.7 

81.3 

74.9 

68.7 

64.0 

49.3 j 

44 0 

39.1 

31.6 


6. Solve the preceding example by the method of averages. 

7. Find by the method of least squares a formula of the type 
y = a + which will fit the following data : 


X 

7.87 

11.50 

16 40 

22.60 

32.80 

y 

0.2 

0.4 

0.8 

1.6 

3.2 
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8 . The data in the table below can be fitted by a formula of the type 
x/y = a + 6x. Find the formula by the method of averages. 


X 

3 8 

7.0 

9.6 

11.3 

17.5 

31.5 

45.0 

64.0 

95.0 

y 

10.0 

12.5 

13.6 

14.0 

15 0 

16.0 

16.5 

17.0 

17.5 


9. Work the preceding example by plotting the points {x^x/y) on 
ordinary coordinate paper and finding the values of a and h. 

Hint : Put x/y = u. Then the equation becomes w = a -j- hx, the graph 
of which is a straight line. 

10. In Exercise 3 put = t and plot the equation y = a + &<. Find 
from the graph the approximate values of a and h and then find corrections 
to these values by the general method of Art. 147. 


11. Find by the method of averages a polynomial formula which will 
fit the data in the following table: 


X 

8 5 

9 5 

10 5 

11 5 

12 5 

13.5 

14 5 ! 

i 15 5 

16 5 

17.5 

y 

1260 

1660 

2150 

2850 

3670 

4730 

6050 

7750 

10000 

13050 


12. The data in the table below are to be fitted by a formula having 
y =1 20 as an asymptote. Find the formula by any method. 


X 

0 

1 

2 

3 

4 

5 

6 

7 

8 

9 

10 

y 

84 9 

79 9 1 

75 0 

70 7 

67 2 

64 3 

61.9 

59 9 

57.6 

55 6 

53.4 


13. The table below gives the atmospheric refraction for a star, at 
various altitudes above the horizon. Assume that R'" = o/ (h + tank), 
omit the first and last values in the table, and find a and h by the method 
of least squares. 


h 

0° 

2° 

4° 

6^^ 

8° 

10® 

O 

o 

40° 

60° 

90“ 

R 

34'50' 

18W 

11'37' 

8'23' 

6'29' 

5'16' 

2'37' 

1'09' 

0'33' 

0 



CHAPTER XVII 


HARMONIC ANALYSIS OF EMPIRICAL FUNCTIONS 

150. Introduction. Any periodic function can be represented by a 
trignonometric series of the form 

(1) y = Uo + cos X + cos 2x + • • • + dn cos nx 

+ hi sin X 4- &2 sin 2x + * * * + 6n sin nx. 

This function is periodic and has the period 27r. A periodic function 
having a period different from 27r can be reduced to the form (1) by a 
suitable change of the independent variable (Art. 153). 

When we wish to find an empirical formula to represent a phenomenon 
that is known to be periodic — such, for example, as the tides, alternating 
currents and voltages, mean monthly temperatures, etc. — , we should always 
assume a formula of the type (1). If the values of the function are 
known for certain equidistant values of the independent variable — from 
readings of an instrument, measurements of a graph, or otherwise — , it is 
an easy matter to find the unknown constants flo, O'u' ‘ ' ^n, &i, ^2, • • ‘ . 

In the present chapter we shall give explicit formulas for computing these 
coefficients when the number of equally-spaced ordinates is cither 12 or 24. 
We shall also give schemes for reducing the numerical work to a minimum. 

151. Case of 12 Ordinates. We assume that the period of the unknown 
function is 2-^ and that the value of the function is known for 12 equi- 
distant values of the independent variable. The appropriate formula is 
then 

(151. 1) y = ao + ai cos x -f a2 cos 2x -f- cos 3x + a* cos 4x 
+ fls cos 5x -f- an cos 6x + sin x + sin 2x 

-j- 63 sin 3x +' hi sin 4x + h^ ^in 5x. 

Let the corresponding values of x and y be as given in the table below. 


X 

O'* 

0 

0 

CO 

60" 

0 

0 

0 

0 

0 

150" 

»— * 

00 

0 

0 

0 

0 

0 

0 

0 

0 

300" 

330" 

y 

2/0 

1/1 


Vi 

y* 

1/i 

2/6 

2/7 

2/1 

1/6 

yio 

yii 


Then on substituting in (151.1) each of these corresponding sets of 
values we obtain the following conditional equations: 


498 
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yo = ao + ai + a! + ffl3 + a4 + a5 + a, + 0&i + 0-62 + 0-6a + 0-64 + 0-6,, 
y, = a„ + + 0 • a, — |a4- ^a^-a, + 

+ 6s + -^64 + -| 6 j , 

yj = Oo + -ioi — ~a2 — a, — -ia4 + -|a 5 + o, + -^61 + 


Y3, 


2 " 2 *^ g^s-r^e-r g ‘'it— t/a 

-J_ft ^ Vl, Vlr 
+ 0i. -b. 

— a© “h ^ <^2 “h 0 • 0-3 -{- 0^4 -j- 0 • (Is — (le “h “h 0 • 62 

— 63 + 0 • &4 -f“ 65 > 


— o>Q ■ 


1 1 1 1 . . V3, 

2^2 + ^8 — ^4 —as + tte H 


V3 , . , , V3. V3, 

— 2 62 + 0-6.+ — 64 ^ 65 , 

jft = do — Y " 2 ®® + 0 • Oa — —at “I" -at — at + — 6i 


' 


, Ir 

-^6«+ g6s. 


ye flo fll *4“ ^2 “h fl-5 "f" ^^6 “h 0 ' 61 -j- 0 • 62 

+ 0 ' &3 4“ 0 ■ ^4 + 0 • &6 , 

_ V3 , 1 , . 1 , \/3 1, 

yi — flo — 2 + 0 • tts — ~2^* ~2~^^ — ^ 


, V3, , , V3, 1, 

+ — 6s + -y-64 — g6e , 


1 1 1 1 1 ^ V3, 

ye = tto — - tti — -ao + as — -a4 — -as + —b^ 

+ ^b, + <,-K-^l:+fb., 

y<d clq 4“ ^ ' ai — a2 4” ^ ®3 4“ ^4 4“ ^ 61 4~ 0 * ^2 

4" 63 4“ 0 ■ 64 — 65 j 


2 


2 

V3 


,1 1 1 ^ ^^3, V3. 

yio = ao 4- — "^^2 — as — -^a4 4- “^^3 4 - ^ 61 ^ - 


V 3 ] 


4" 0 • fee 4 — “I” ’ 
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Vii — 0-0 + 


V3 


-& 3 - 





2 


To solve these equations for the o’s and 6's we apply the rule of Art. 
145 for writing down normal equations. Thus, to find Oq we multiply 
each equation by the coefficient of Oo in that equation and add the results. 
We then get 


iSoo — 3^0 + 3/1 + ^2 + ^3 + ^4 + ys + ye + ^7 + ya + ^9 + yio + yu y 


which gives Oo explicitly in terms of the known quantities yo, yi, • ■ * yn • 

To find Oi we multiply each equation by the coefficient of Oi in that 
equation and add the results. This gives * 


. , V3 , 1 1 \/3 

601 = yo + — yi + -y2 — -^y^ ^ys — ye - 

,1 , V3 

+ H — ^y^i • 


V3 


2 


Continuing in this manner, we get the following equations for finding 
the remaining a’s and 5’s : 


* The reason for the disappearance of all the o’s and 6’s except one in the normal 
equations is as follows: 

Since the multipliers used in obtaining the normal equations are sines and cosines, 
the coefficients of the a’s and b’s in the resulting normal equations are all of some 
one of the forms 

^ sin pwrf X JL P^r sin qxr, ^ sin pxr cos qx^, cos pxr cos qx„ 

r r r r r 

2 ; sin* pXr, X 

r r 

where r takes the values 0, 1,2, ■ (m — 1), and m is the number of equidistant 

ordinates. But 

^ sin pXr = 0, 2^ cos qXr = 0, 21 

r r ' 

2^ sin pXr sin qXr — 0 

r 

2^ cos pXr cos qXr = 0 

r 

2 sin* pXr = y X cos* qXr—'!^, 

Since only one of the a’s or b's in each normal equation has a coefficient of the form 
2^ sin* pXr or ^ cos* qXr, it is evident that all but one must disappear. 

r r 

For a simple and elegant proof of the relations given above, the reader is referred 
to Runge and Konig’s Numerischea Rechnen, page 212. 


if P 9. 
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6aj_yo+ gt/i — — iy, 

I I 1 
2^/io 2 2 / 11 } 

Caa = 2/0 2/2 + 2/4 — 3/6 + 2/h — ^ 10 , 

6a4 = y„ — -yi — -^yj + y, _ -|y^ _ iy^ + y, _ iy, _ lyg 

I 1 1 

+ yo — '^Vio — , 

a — . V3 1 1 , V3 , V3 1 

60, _ 2/0 ^.Vi + --ys — -y. + "y yi> — yo + y -yr — gye 

. 1 V3 

+ yio — 2 ’ ) 

12a, = yo — yi + y 2 — ya + y4 — ys + ye— yi + ys— y» + yio— yii, 

Cl _ 1 , V3 , , V3 , 1 1 V3 

— “2^1 H ^"“^2 + ya H — ^y* + -^ya — yT — “2“^® 

V3 1 
y» 2 2 ^'* ’ 

662 = -—(yi -(- ya — y, — ya + y7 f y, — yio — yu), 

6&a = yi — ya + ya — y, + y, — yu , 

3 

66, = (yi — yj + y, — y, + y? — ya + yi, — yu), 

1 V3 , V3 , 1 1 , V3 

66e — -gyi ^y 2 + ya — 2 ^° ^ 2 ^’”^ 2 

, V’3 1 

+ -yy*®— 2^'*- 

We could find the values of the a’s and Fs directly from these equations, 
but it would be a tedious process on account of the large number of terms 
in the right-hand members. AVe therefore reduce the number of terms 

on the right by grouping terms and substituting new variables for the 

different groups. The first grouping gives 

120 , = (y, + ye) + (yi + yn) + (ya + yn>) + (y» + y®) + (y® + y®) 

+ (ya + yt). 
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6»i — (yo — ye) + + yii) H" ■|(y2 + yio) — ■! (ye + y») 

602 = (yo + ye) + -g(yi + yii) — "^(yj + yio) — (ye + ye) 

— ■|(ye + ye) + ^(ye + yr), 

6oa = (yo — ye) — (ye + yio) + (y* + y*), 

6ae = (yo + ye) — -|(yi + yn) — ^(ye + yio) + (ye + ye) 

— •|(y« + ye) — |(y. + yr), 

605 = (yo — ye) — ^(yi + yii) + -|(ye 4 - yio) — •|(ye + y,) 

+ ^“(y® 4 " yr), 

na, = (y„ + ye) — (y, + y„) -f. (y^ + y^„) — (y, -f- y,) -|- (y, + y,) 

— (y» 4-y7), 

661 = ^(yi — yii) 4 - ^ (ye — yio) 4 - (ye— ye) 4 - ^(ye — ye) 

4 - -|(y»— yj), 

V”3 

66e = -^[(yi — yii) 4- (ye — yio) — (ye — y») — (ye — ye)], 

66, = (yi — yii) — (ye — yo) 4- (y» — yi), 

66e= -^[(yi — yii) — (ye — yio) 4 - (ye — ye) — (y* — y,)], 
66e= ^(yi — yn) (ye — yio) 4- (ye — ye) (ye — ye) 

4 - ^(ye — yt)- 
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Let US DOW put 

yo + ye =«o yo — ye =Vo 

Vi + yii = 111 Vi — Vii = vi 

Vi + yio = «2 yt — yio = Vi 

y» + ye = Me ye — ye = M, 

ye + ye = M* yi — yg = tig 

ye 4- y? = Mg ye — ye = v. . 

Then the normal equations become 

120o = «0 + Ml + Ug + Mg + Mg + Ug = («0 + Mg) -f (tii + «») + (tig + Mg), 

1 . , VT , 1 1 V3 , V3, . 

6ai = Mo + + -gMg — gMg = Mo + -^(Mi — Mg) 

+ 

GOg = tio + iMi — -iug — tig — -|tig + -|Mg = (tio — Mg) 

+ |(Mi + M.) — I (Mg 4- tig), 

Gag = Mo — tig 4- tilg = Mo — (tig — Mg), 

Gog = tio — -|mi — -|tig + tig — -|tig — -itig = (Uo 4- Mg) — ■|(m, + u») 
— -|(Mg 4- tig), 

V3 ,1 1 , V3 V3, « 

GUg = Mo ^Mj 4- -gMg — ^g H ^tig — Mo 

+ ■|(Mg — Mg), 

120e = Mo — Ml -|- tig — tig + Mg — tig = (tio — Mg) — (tii + tig) + (Ug + tig), 

66i =^Mi 4- -^Mg 4- Mg 4- ^Mg 4- -iog = |(»i 4- Mg) 

4" (Me 4“ Mg) 4" Mg , 

66, = ^^(Mi 4- Mg — Mg — Mg) = -^[(Mi — Mg) 4- (Mg — Mg)], 

66, = Ml — t», 4- Mg = (Mi 4" Mg) — M, , 
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664 = {Vi — V2 + Vi — Vo) = — Vb) — (Vj V4) J, 


«!». 1 V3 , V3 , 1 1 , , , 

= 2 + Vb + — j^B = -g {v, + r,) 

V "3 

If we make the further substitutions 

Uq U 3 = Vo Uo — Us = So Vi + Pi Vi — Vo = 

Wi + W5 = Ti Ui W5 = Si V2 + V4 = P 2 V 2 V4 = ^2 , 

^2 + ^4 = r.2 U 2 W4 == ^2 

he normal equations take the simpler forms 

12ao = Tq -f- “f~ ^2 — ^0 “f" (^1 “I” '^ 2)9 

^ , 1 

6 ai — Vo H ^ -Si -f- ~ ^2 > 

-C (C 

6*2 = 5 „ + ^r. — r. = So + 2 (’■* — 


Ga-i =i Vo - ■ Sj , 

60.4 = Tq —r I 


~r 2 = ro — ^(ri + r^), 


c V3 , 1 

12 a 6 = 5 o — n + ro = 5 o — (vi — Vz), 

_ 1 . V3 , _ ,1 , V's 

"2^1 + 2 “*^3 + -gpl H ^p 2 ^ 

^^2 = + ^ 2 ), 

^^3 = Pi ^3 , 

664 = —{qi — q^), 

fii> 1 VT , ,1 V 3 

6 i>» = -^Pi + V, = V, 4 - „-p. — p, . 
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Finally, we write 


ri + ra = Z 


-ro = m 


+ ?2 — 9 
gi — ga = h. 


Then the equations for finding the coefficients in the trigonometric series 
are 


^o = ^(ro + Z), 


( 161 . 2 ) 




a3 = |(vo — S 2 ), 


(I5 


an — Y2 




A 

62 =- i ^< 7 , 

^3 = |(P. — I’a), 

63 - 12 


1/ ■ 1 V3 \ 

63 — -g + gPi 2 ■ 


The several substitutions made above can be accomplished very simply 
by the addition and subtraction scheme given below,* starting with the 
given y’s. 


* Such schemes for computing the a’s and 6 ’a were first devised by Runge about 
the year 1903. See Zeitschrift f'ir Math, und Physik., XLVIII (1903), p. 443, and 
UI (1906), p. 117. 
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Vo Vi y2 ys y* y^ 

ye yn yio ye ys yi 

Sum Uq Ui Uz Uz 

Diff. Vi Vz Vs V4 


Uo Ui Uz 

Ua Ua U4 

Sum Fq fi Vz 

Diff. Sq Si Sz 


Vi Vz 
Vn V4 

Pi P2 
Qi q 2 


Ti qi 

Tz qz 

Sum I g 

Diff. m h 

The quantities Vq, v^, and Tq are printed in heavy type because they are 
somewhat isolated from the other quantities which appear in the final 
formulas for the coefficients. 


Check formulas. Since the chances of making an error in the additions 
and subtractions are considerable, it is important to have a reliable check 
on the computed a’s and ft’s. As a check on the a’s we have from the first 
conditional equation 

yo — ^0 + + ^3^2 -}- <13 + a* + ^6 -|- fle • 

To find a check for the ft’s we subtract the twelfth conditional equation 
from the second, giving 

yi — yii = -h V 352 + ^^3 V 354 + 5 b ; 

or, since 

Vi = yi — yii y 

Vi = hi ha 2 ha -f- V 3(52 “|~ h^). 

The check formulas are therefore 


( 151 . 3 ) 


( 2a — yo , _ 

( ( 5 i -j- 55) -j- 253 -f- V 3(52 54) = Vi . 


We shall now work an example to show the application of the above 
scheme. 


Example 1 . Find an empirical formula to fit the following data: 
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X 

0“ 

30 “ 

60 “ 

90 ° 

0 

0 

wH 

160 ° 

180 ° 

210 ° 

240 ° 

270 ° 

300 ° 

330 ° 

y 

9.3 

15.0 

17.4 

23.0 

37.0 

31.0 

15.3 

4.0 

- 8.0 

- 13.2 

-14 2 

-6.0 


Solution. The first part of the computaticn is carried out according to 
the scheme given above and should be self-explanatory. 


y’B 


Sum (u) 
Diff. (v) 

u’s 


Sum (r) 
Diff. (s) 


0 

1 

2 

8 

4 

5 

9.3 

15.0 

17.4 

23.0 

37.0 

31.0 

15.3 

— 6.0 

— 14.2 

— 13.2 - 

- 8.0 

4.0 

24.6 

9.0 

3.2 

9.8 

29.0 

35.0 

— 6.0 

21.0 

31.6 

36.2 

45.0 

27.0 

0 

1 

2 


1 

2 

24.6 

9.0 

3.2 

v’s 

21.0 

31.6 

9.8 

35.0 

29.0 


27.0 

45.0 

34.4 

44.0 

32.2 

Sum (p) 

48.0 

76.6 

14.8 — 

26.0 

25.8 

Diff. {q) 

— 6.0 

— 13.4 


r’8 

44.0 

g’s 

— 6.0 


32.2 


— 13.4 

1 

= 76.2 

9 = 

— 19.4 

m 

= 11.8 

h = 

7.4 


Now substituting these quantities in equations (151. 3), we get 
ao = -,^(34.4 + 76.2) =9.22, 

a. = I 6.0 — 26^ — 12.9^ = — 6.90, 

aj= ^(14.8 + 5.9) =3.45, 

6 

o, = i(— 6.0 + 25.8) = 3.30, 

6 

a, = (34.4 — 38.1) = — 0.62, 

6 

a. = -!(- 6.0 + 26-^ - 12.9) = 0.60, 

a,= -^(14.8— 11.8) =0.26, 
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= 4 (36.2 + 24.0 + 66.3) = 21.09, 

6 

6, = ^(—19.4) = — 2.80, 

6, = i- (48.0 — 36.2) = 1.97, 

6 

6, = ^^(7.4) =1.07, 

65 = 4- (36.2 + 24.0 — 66.3) = — 1.02. 

6 

Applying the check formulas (151. 3), we have 

= 9.30 = yo , 

(fti-f-fts) -j-263-f- \/3(ft2“l“&4) — 21.01 = Vi. 

The coefTicients are therefore correct and the final formula is 

y z=z 9.22 — 6.00 cos x + 3.45 cos 2 .t -{- 3.30 cos 3x — 0.62 cos 4x 
+ 0.60 cos 5a: + 0.25 cos 6x -f- 21.09 sin x — 2.80 sin 2a: 

+ 1.97 sin 3r + 1.07 sin 4a: — 1.02 sin 5a:. 

Note, Since the terms of a trigonometric series are additive, it is 
necessary that the coefiicients all be computed to the same number of 
decimal places (Art. 7). 

152. Case of 24 Ordinates. For 24 equally-spaced ordinates the values 
of X are taken at equal intervals of 15° apart from 0° to 345° inclusive. 
The appropriate formula for this case is 

(152. 1) y do + ai cos x-\- a 2 cos 2a: a;, cos 3x + a^ cos 4a: -f- a^, cos 5x 

ao cos (jx -4- ay cos 7a: + Uh cos 8a: + a^ cos Oa: + ttio cos 10a: 
-f- an cos 11a: + a, 2 cos 12a: -|- sin x ^2 sin 2a: + ^3 sin 3a: 
+ 64 sin 4a: -f 65 sin 5a: + ho sin 6a: + sin 7a: + ba sin 8a: 

4- bo sin 9a: -f 5io sin 10a: -|- ftn sin 11a:. 


X 

0 ° 

15° 

30° 

1 

45° 

60° 

75° 

90° 

105° 

120° 

135° 

150° 

165° 

180° 

y 

2/0 

2/1 

2/2 

2/3 

2/4 

2/4 

2/6 

y^ 

2/8 

2/9 

2/10 

2/11 

2/13 


X 

195° 

210° 

225° 

240° 

255° 

270° 

285° 

300° 

315° 

330° 

I 345' 

y 

2/13 

2/14 

2/18 

J/18 

2/17 

2/18 

2/19 

2/30 

2/31 

2/23 

2/33 
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Let the corresponding values of x and y be as given in the table above. 
Then on substituting in (152. 1) these corresponding values of x and y 
we get 24 conditional equations. Applying to these the rule for obtaining 
normal equations, we get 24 equations in which the a’s and ft’s are given 
explicitly in terms of the y’s. Then we group the terms in the right-hand 
members, substitute new variables for the different groups, group again, 
etc., just as in the case of 12 ordinates. The final formulas for computing 
the a’s and 6’s are found to be as follows : 


do — ■^(^0 + 

dl = Y - (^Vq -f- CSi + “^^2 + + "2 > 

_ 1 / , Vi ,1 \ 

d2 — Mo H “1“ ) * 

CL%— ^2)? 

^ V 3 + i** “ ’ 

3")’ 

1 / V 3 , 1 ^ 

®” ^ ^ ^ “ 7 f ' 

ai2 = 


bi=^ + |P* + V2^* + ^P» + ^•) . 


( 162 . 2 ) 
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b2 


6$ 


64 


6. 

h, 

h 

ba 

ba 


= ^ ~ - p»)) ’ 

-^C 

24 ’ 

~ 12 ■*■ ' 2 ^‘ ■“ Vl^‘ ■'" ”*) ’ 

— 12 

= i (cp. - ~P. - ip. + :pp. + Sp. - ..) , 

--M^’ 

= ~(va-p2 + ^(p^ + p.-pa)), 


~ 12 ~ 2 ^‘ ■*■ V2^‘ ~ “" ’ 


where C = cos 15° = 0.9659258, S = sin 15° = 0.2588190, and the other 
quantities are obtained from the given y^s according to the following 
scheme : 


Vo 

y\2 

Vi 

2/23 

y22 

ya 

y2i 

y* ys 

y2o 3/10 

ye 

yi8 

yi 

yiT 

ye 

yie 

y*> 

yie 

yio 

yi4 

yii 

yi8 

Sum Uq 

u, 

th 

U3 


Uz 

«e 

Ui 

Us 

Uo 

Uio 

Uii 

Diff. ro 

Vi 

V2 

Vz 

V4 

Vz 

»e 

V7 

Us 

Vo 

Vio 

Vii 

Uo 

Ui 

U2 

Uz 

U 4 

Uz 



Vi 

V2 

Vz 

Vi Vz 

Uf, 

Uii 

Uio 

Uo 

U3 

Uf 



Vii 

Vio 

Vo 

Vs Vj 

Sum ro 

Ti 

Tz 

Tz 


^6 


Sum Pi 

Pa 

pa 

P* Pa 

Diff. So 


S2 

S3 

S4 

Sz 


Diff. qi 

92 

93 

94 9» 

To 

ri 

r2 



9 i 

92 





hi 

U 

To 

U 




Jl 



h 


ha 

Sum lo 

h 

~h 


Sum gi 

92 


Sum 

e 

Sum c 

Diff. mo mi 

m2 


Diff. hi 

ha 


Diff. 

f 

Diff. d 
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Here the quantities Vq, Ve, d.nd qs are printed in heavy type because 
they are somewhat isolated from the other quantities which appear in the 
final formulas for the coefficients. 

A check formula for the a’s is given by the first conditional equation^ 
and is 

2a = t/o . 

To find a check formula for the 6’s we subtract the 23d conditional 
equation from the second and obtain 

yi — 3/23 = Vi — 2 iS ’ (bi -f- bii) -f- (^2 + ^10) ~h ( 2^3 ^9) 

“h “I- 2 C{b^ 2 b 0 . 

The check formulas are therefore 

1 'Za = yoy _ _ 

2S(b, + + {h + 610 ) + V2(63 + 69 ) + V3(64 + &«) 

“h {bs b 7 ) 2&6 ~ Vi . 

Example 2 . Find an empirical formula to fit the data in the following 
table : 


X 

0° 

15° 

30° 

45° 

60° 

75° 

90° 

105° 

120° 

^ 135' 

150° 

165' 

180° 

y 

149 j 

137 

128 

1 

126 j 128 

135 

159 

178 

189 

191 

189 

187 

178 


X 

195° 

210° 

225° 

240' 

255° 

270° 

285° 

300° 

315° 

330° 

345° 

y 

170 

177 

183 

181 

1 

179 

179 

185 

182 

176 

166 

160 


Solution, The preliminary quantities are found by the scheme below: 

0 1 2 3 4 6 6789 10 11 



J/’s 

149 

178 

137 128 

160 166 

126 

176 

128 

182 

135 

185 

159 

179 

178 189 

179 181 

191 189 

183 177 

187 

170 

Sum 

(w) 

327 

297 294 

302 

310 

320 

338 

357 370 

374 366 

357 

DifiF. 

(v) 

—29 

—23 —38 

—50 

—54 - 

-50 

—20 

— 1 8 

8 12 

17 




0 

1 

2 


3 

4 

6 




u’s 

327 

297 

294 

302 

310 

320 





338 

357 

366 

374 

370 

307 



Sum (r) 665 654 660 676 680 677 

Diff, (5) _ 11 — 60 — 72 — 72 — 60 — 37 
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1 

2 8 4 

6 



v’s 

— 23 — 

38 — 50 — 54 

— 50 




17 

12 8 8 

— 1 


Sum 

(p) 

— 6 — 

26 — 42 — 46 

— 51 


Diff. 

(9) 

— 40 — 

50 — 58 — 62 

— 49 



0 

1 2 


1 

2 

r’s 

665 

654 660 

1 

— 40 

— 50 


676 

677 680 

— 49 

— 62 

Sum (1) 1341 

1331 1340 

Sum (ff) 

— 89 

— 112 

Diff. (m) — 

-11 

— 23 — 20 

Diff. (h) 

9 

12 



Ps 1331 

h^B 9 





1340 

12 





e = 2671 

c= 21 





/= —9 

d = — 3. 



Now substituting these quantities 

in (152. 2), wo i 

6nd 


do = 167.167, 

a, - 

^ — 19.983, 

02 = — 3.410, 

Os = 5.471, 

a4 = — 1.292, 

O’s = 

= 0.250, 

Oo = 0.750 

0, = 0.309, 

as = 0.458, 

Ug — 

= — 0.301, 

Oio = — 0.090, 

ail — — 

-0.243, 

ai2 = — 0.083. 






2,^ - „ 12.779, 

6. 

— — 16.625, 

&3 = -- 0.323, 

6.= 

1.516, 

65 = 1-462, 

6, 

— 2.583, 

6, = 0.322, 

6s = 

— 0.216, 

bg = 0.677, 

bio 

= — 0.459, 

6„ = — 0.640. 




The check formulas (152. 3) give 

2a = 149.000 == yo, 

2S(bi “h ^ii) “1“ (^2 “h ^lo) ~1“ V^(^3 “1“ “h V3(2^4 “t* ^s) -f- 2C(hn ^7) 
+ 2&e = — 22.997 =r vi , 

practically. 

Hence the required formula is 

y z=z 167.167 — 19.983 cos x — 3.410 cos 2x + 5.471 cos 3x 

— 1 .292 cos Ax 0.250 cos 5x 0.750 cos %x 0.309 cos 7x 

0.458 cos Sx — 0.304 cos 3x — 0.090 cos lOx — 0.243 cos 11a: 

— 0.083 cos 12a: — 12.779 sin x — 16.625 sin 2a: — 0.323 sin 3a: 

1.516 sin 4a: + 1.462 sin 5x — 2.583 sin 6x + 0.323 sin 7x 

— 0.216 sin 8x + 0.677 sin 9x — 0.459 sin lOx — 0.640 sin llx. 



Abt. 163] 


MISCELLANEOUS MATTERS 


513 


153. Miscellaneous Matters. 

(а) . Computation of the Coefficients for Any Number of Equidistant 
Ovdinates, In this chapter we have considered only the cases where the 
number of given ordinates is 13 or 24, because these are the most important 
cases from a practical standpoint. It is possible, however, to derive 
formulas for the a^s and J’s in the case of any number of equidistant 
ordinates, such as 6, 8, 10, 16, 20, etc. The method of procedure in all 
these cases is exactly the same as that in the case of 12 ordinates. Com- 
puting schemes for the cases just mentioned are given in Bunning’a 
Empirical Formulas, pp. 76-85. 

Poliak’s Recheniafeln 2ur Harmonischen Analyse enable one to find 
the a’s and 5’s directly from the normal equations for any number of equi- 
distant ordinates from 3 to 40 inclusive. The tables are accompanied by 
full directions for their use. 

(б) Periods other than 2’jr. When a function is periodic and has a 
period different from 27r, we change the independent variable by a linear 
substitution. Thus, if x is the independent variable and the given func- 
tion is y = f(x), we write 

(1) x = Jc-\-m$. 

If the limits for x are g and h and we wish the limits of ^ to be 0 and 
27 r, we have only to substitute in (1) these corresponding values of 
x and 0 and then solve the resulting equations for k and m. Hence in 
this case we have from (1) 

^ = fc + 0, or k = g-, 

and 

h = k 2wrn g 2irm. 


Hence m = {h — g ) and the desired formula of transformation is 


(153. 1) 




2ir 


or 


0 _ g^^(a; — g) 
h — g 


In all these cases the proper formula to assume for y is 
(153. 2) y = fflo + cos ^ cos 2ff 4- • ■ • -f a„ cos n$ 

— 1“ hx sin B "bz siu 2^ — |— * * -j- sin (w **- 1^^. 

For example, if the period of a phenomenon is known to be 18.3 days 
and we wish to use 12 equidistant ordinates, the values of x corresponding 
to these ordinates would be Xo = 0, Xi = 18.3/12 = 1.525, Xa = 3.050, etc. 
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The corresponding values of 6 would be 0°, 30°, 60°, etc. The values of 
the a’s and ft’s in (153.2) would be found by substituting in (153.2) 
these values of 6 and the corresponding y% or simply applying the 12- 
ordinate scheme to the given y’s. The resulting formula in terms of x 
would then be, by (153.1) and (153.2), 

(2) y = flo + ffli cos + 02 cos 2 + • ' • 

+ + ■ ■ ■ ■ 

(c). Caution in the Use of Empirical Formulas. Empirical formulas 
are really interpolation formulas of particular forms, and are therefore 
subject to all the limitations of interpolation formulas. They can be relied 
upon for all values of the independent variable within the range of values 
used in determining the coefficients, but should not be trusted outside of 
these limits, except possibly for very short distances outside the range of 
values used. Stated otherwise, empirical formulas may be used for inter- 
polation but not for extrapolation. 

If, however, the given function is known to have a certain form for all 
values of the independent variable, we may use the formula for computing 
rough values of the function outside the range of values used in deter- 
mining the coefficients. 


EXERCISES XVII 

1 . Find a periodic function that will fit the following data: 


X 

0° 

o 

O 

CO 

60° 

90° 

120° I 

0 

O 

o 

O 

00 

210° 

240° 

270° 

300° 

330° 

y 

38.4 

1 

11,8 

4 3 

13 8 

3 9 

-18 1 

-22 9 

-27 2 

-23 8 

8 2 

31 7 

34.2 


2. Do the same for the following: 


X 

0° 

15° 

o 

o 

45° 

o 

O 

CO 

75° 

90° 

105° 

o 

O 

135° 

o 

O 

165° 

180° 

y 

45 

no 

142 

128 

138 

88 

-2 

-12 

-25 

-39 

-21 

-38 

-69 


195° 

210° 

225° 


255° 

270° 

285° 

300° 

316° 

330° 

345° 

-78 

-90 

-112 

-92 

-70 

-45 

25 

68 

59 

40 

54 























EXERCISES 


516 


3 . The equation of time for twelve equidistant intervals in a certain 
year is given in the following table. Taking the period of this phenomenon 
to be 365.2 days, find an empirical formula that will give its value at any 
instant in that year. 

3“10“.9, 13*''30».4, 12"™20».6, 3™53».6, — 3"™2«.7, — 2*"22*.6, 3™42».0, 
9'"10».0, 0“9».3, — 10™13».8, — 16™18^2, — 10"'59«.6. 

4 . The period of a certain phenomenon is 14.4 days. Twenty-four 
values for equal time intervals are given below. Find an empirical formula 
to represent this phenomenon. 

2.4, 5.6, 6.7,^ 7.4, 8.8, 9.9, 10.4, 12.0, 13.8, 14.9, 16.4, 16.8, 17.5, 
18.4, 19.2, 20.8, 21.4, 20.5, 18.5, 16.0, 15.1, 14.8, 12.2, 6.4. 



CHAPTEH XVIII 


NUMERICAL SOLUTION OF SIMULTANEOUS LINEAR 

EQUATIONS 

Various methods have been devised for the numerical solution of simul- 
taneous linear equations. Some of the methods are of general applicability, 
while others are somewhat restricted in their application. Perhaps no single 
method is best in all cases. In the present chapter some of the best general 
methods are explained and illustrated by numerical examples. 


I. SOLUTION BY DETERMINANTS 


154. Evaluation of Numerical Determinants. In the following pages 
it is assumed that the reader is familiar with the elementary properties of 
determinants to the extent given in the usual college algebras. 

a) Expansion in terms of minors. The minor of any element of a 
determinant is the determinant which remains after deletion of the row 
and column containing the element. Any determinant may be expanded 
in terms of the minors of the elements of any tow or column. The elements 
of the first row or first column are usually the most convenient for expan- 
sions in terms of minors. Thus, the determinant 


D = 



a.j 

U 3 

at 

b^ 

iz 

is 

is 

Cl 

Cj 

^3 

Ci 

di 

do 

ds 

dt 


may be expanded with respect to the elements of the first row as 


D = ai 

&2 ^8 ^4 

C2 Cft C4 

On 

^3 ^4 

Cl C3 C4 

+ fls 

hi 62 h^ 

Cj Co C4 

— a* 

hi 62 63 

Cl C2 C3 


^2 da d^ 


di da d^ 


dj d^ d^ 


di d2 da 


or with respect to the elements of the first column as 



bo b^ b^ 


flo fla a^ 


a 2 0-3 a^ 


On a^ 

D = ai 

C2 C3 C4 

d2 da d^ 

— bi 

Co C3 C4 

do da d^ 

+ Cl 

b'j bs b^ 

1 d 2 da d^ 

— di 

2^2 bg b^ 

C2 Cq C4 


The resulting third-order determinants can be expanded by the rule for 
expanding determinants of the second and third orders. 


516 



Art. 164] EVALUATION OF NUMERICAL DETERMINANTS 617 

Note that in the above expansions by minors the signs alternate^ whether 
the expansion is with respect to the elements of the row or with respect 
to the elements of the column. 

Example, To evaluate the determinant 

3—125 

1 —3 2 6 ’ 

2 4 3 1 

we expand it in terms of the elements of the first row and have 



3 4 1 


— 2 4 1 


— 2 3 1 


— 2 3 4 

to 

II 

09 

— 3 2 6 

4 3* 1 

+ 1 

12 6 

2 3 1 

+2 

1—3 6 

2 4 1 

—5 

1—3 2 

2 4 3 


= 129 + 75 + 194 — 385 = 13. 


Although the method of expansion by minors is simple and is very 
important theoretically, it is too long for practical use in determinants 
higher than the fourth order. 

h) The pivotal method. In this method of ev^aluating a determinant 
the order of the determinant is systematically reduced step by step, the 
leading element (called the pivot) pla^ung a more important role than any 
other element. To derive the formula for the pivotal expansion, let us 
consider the nth-order determinant 

a^ fl2 * 

bi 62 ^8 ^4 ’ 

Cl C2 Cs C4 ' 

dj d^ d^ d^ 


Multiply the elements of the 2d, 3d, • • • nth columns by ai and compensate 
by dividing the determinant by Then 

Uj U 1 U 4 *' 

hi ajJ)2 a^ihs ®i^4 ’ 

(2) D=^l/ai”-^ Cl aiCi aiCs UiC*- • • 

di aid2 aidg aid^ * 
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Now multiply the elements of the first column of (1) by a 2 ,a 8 , * * in 
succession and subtract the results from the 2d^3d, * * nth columns of 
(2). We thus get 


D = 


which becomes 


ai 0 0 0 

Cl fliC 2 ““ ^ 2^1 (tiC^ CL^Ci (liC^ Ct^Ci 
di ttid2 ^2^1 (iid^ CL^di Orid^"“~ CL^di 


D = l/oi"-* 


CL\C2 ~~~ ^2^1 CL^Ci CliC^ O14C1 

^ 1^2 OfQdi cLid^ ” ■ ■ dgdi Q>id^ CL^di 


when expanded by minors with respect to the elements of the first row. 
We have thus derived the important reduction formula: 


( 3 ) 


«1 

^2 


a4 * • • 



; 62 

6. 

64- • • 



I 

Cs 

c. - • • 

= 1/ai"-* 


1 

d . 

d .- ■ ■ 



^ 1^2 ^‘£^1 ^ 1^4 ® 4^1 ’ 

fllCjj ““ flsCj aiC4"““fl4Ci* 
0'jd2 ~~~~ d’>di cLyd^ — CL^di CLid^'~~“ €L\di ’ 


Since each application of (3) lowers the order of a determinant by one, 
a continued application of it will reduce any determinant to the third 
order or even to the second order. 

Formula (3) shows that the first column of the new determinant of 
lower order is obtained by multiplying by Ui each element in the first 
column of the minor of ai and « then subtracting the product of the element 
at the top by the element at the extreme left. The elements in the second 
column of the new determinant are obtained in the same manner. This 
procedure should be memorized and applied as a working rule: ai times 
any element, minus the elemefit at the top times the element at the 
extreme left. 

Example. Applying this rule to the numerical determinant evaluated 
above by minors, we have 
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3 

— 1 

2 

5 


7 

16 

13 

— 2 ' 

1 

3 

4 

1 

1 

— 8 

4 

13 

1 • 

1 

— 3 

2 

6 

“ 9 

14 

5 

— 7 

2 ■ 

1 

4 

3 

1 






D = 


1 117 

= q (— 196 + 2912 — 520 — 728 — 455 — 896) = = 13. 

^ y 

c). The triangular method. Another important method of evaluating 
a numerical determinant is to reduce it to triangular form and then take 
the product of the elements in the leading diagonal of the triangular 
determinant. A triangular determinant is one in which all the elements 
on one side of the leading diagonal are zero. Any determinant 

flu fli2 fli3 ‘ ‘ * flin 
fl2i fl22 ^23 * * * ^2tl 

(4) D =■ flgj fl32 flss ■ * * flsn 

^ni ^2 ®n3 ‘ * * ^nn 

can be reduced to triangular form by the following procedure: 


Multiply the first row successively by — , — , 

flu flu 


results from the 2d, 3d, • • ■ nth rows. 


flu 

We thus obtain 


and subtract the 


(S) 


where 


D = 


flu 

flj 2 

flis ’ 

* fl’in 

0 

h’>2 

&23 ’ 

■b,„ 

0 

^32 

&33 ' 


0 

&42 

^43 ■ 

■b.„ 

0 

t)n2 

2^/13 ‘ 

’ &nn 


flj2 ^12» ^23 ^23 

flu fll 

flai ^ ^ ®31 


fl'isj etc. 


1 **31 1. 

O^o HH a-iO fll24 ^33 ®33 ®13> SIC. 

flu ®11 ' 

Now leaving the first row of (5) as it stands, we multiply the second 

row successively by • -N and subtract the results from the 

0-22 ^22 ^22 

3d, 4th,- • -nth rows of (5) and thereby obtain 



520 


SOLUTION OF SIMULTANEOUS LINEAR EQUATIONS [Chap. XVIII 


( 6 ) 


where 


D = 


flll 

fll2 

flia ■ 

* ttin 

0 

^22 

&2S ■ 

' &2»l 

0 

0 

^88 ‘ 

■ Can 

0 

0 

^48 ‘ 

•C4n 

0 

0 

Cna * 

•Cnn 


Caa — &33 — 


Z>32 y 

r“ 

?22 

^48 = ^48 ^2 


etc. 


etc. 


By continuing this process we reduce (4) to the triangular form 


iV 


D=: 


flu 

fl 1 2 

fll3 ‘ 


■ flin 

0 

ft 22 

^23 ‘ 


■ ft2n 

0 

0 

C 33 ' 


■ Can 

0 

0 

0 

^44 * 

'd^n 

0 

0 

0 

0 • 

^nn 


The value of the original determinant (4) is the product of the diagonal 
elements of (T), or 

(8) I) flli&22<^33d44 ' • Inn- 

To prove this fact we expand (7) successively in minors with respect 
to the elements of the first column of each successive determinant. Thus : 


D — flu 


^22 

^28 ’ 

' ft2n 


C 33 

C 34 * 

■ Can 

0 

Caa ' 

' Can 


0 

^44 ‘ 

■ d4n 





0 

0 


0 

0 


flli&22 




0 

0 



0 

0 

^nn 

0 

0 

hn 






flll&22C83 


<^44 ^45 

0 ^56 ' 

0 0 




0 0 hn 

and continue the expansions until we arrive at (8). 
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If the elements of the determinant are inexact or rounded numbers, 
the denominators flu, & 22 , etc. of the fractional multipliers should be as 
large as possible in order to reduce errors as much as possible. Inter- 
changes of rows or columns will usually enable the computer to bring the 
largest elements' to the positions of o-n, 622 ? etc. 


Example. We now apply the triangular method to the determinant pre- 
viously evaluated by other methods. 

3—125 
— 2 3 4 1 



I 2 4 3 1 I 

On multiplying the first row successively by then adding the 

first result to the second row and subtracting the next two results from 


the third and fourth rows, respectively, 

we 

get 


3 

— 1 

2 

5 


0 

7 

16 

13 


3 

3 

3 

D = 

0 

8 

4 

13 


~3 

3 

3 


0 

14 

5 

7 


3 

3 

"”3 


Now multiplying the second row by y and 2 in succession, adding the 
first result to the third row and subtracting the second result from the 
fourth row, we get 


3 


D = 


0 


0 

0 



Finally, on multiplying the third row by 


13 

3 


65 

T 

-11 

— and adding the result to 


the fourth row, we obtain 
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1 

2 

5 

7 

16 

13 

3 

3 

3 

0 

52 

65 

7 

7 

0 

0 

1 

4 


Hence 

^ = 3x|xf Xi =13. 


Concerning the merits of the three methods given above for evaluating 
a numerical determinant, the method of expansion in terms of minors is 
the least desirable of the three. As to the other two methods, the pivotal 
method is preferable when the elements of a determinant are simple 
numbers of one or two digits such that they can be multiplied and sub- 
tracted mentally. When the elements are numbers of several digits, the 
triangular method is the best method of evaluation. 


155. Cramer’s Rule. A simple method of solving simultaneous linear 
equations by determinants was discovered by Gabriel Cramer* in 1760. 
To derive Cramer^s rule, as it is called, we consider a system of three 
equations 

^ aiX -h fl2y + ^82 = 

(1) J hiX + h2y + h^z = k2 

c^x C2y + c^z = fcj. 

We first write down arbitrarily the determinant 

(aiX -f ag Og 

(2) {h^x + biy + h^z) 62 63 

(cix + C2y + Csz) C 2 Cg 

From (1) the elements in the first column of (2) are equal to A:,, fcg, fcg, 
respectively. Hence "we may write 

(aiX + azy + a^z) az ag 

(3) {biX + hzy + bzz) 62 bs 

(cix + Czy Csz) C 2 Cg 

* Swiss mathematician (1704-1752). 
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The addition law of determinants states that the left member of (3) 
may be expressed as the sum of three determinants^ as follows : 

aix flo ^8 oLiy a^z 

hlX &2 &8 — j- ^ 2 y ^2 ^3 “I” ^2 ^8 

Clip Cj Ca Cj^y C* Ca CaZ Cg Ca 

Factoring out x, y, and z from the first columns of these determinants and 
replacing the left member of ( 3 ) by the above sum, we have 

di (I2 da da da da da d^ da Ic^ da da 

hi ha ha X ha ha ha y ha ha ha Z K 62 &s 

Cl C2 C3 C3 Co C3 C3 C2 Ca ^3 Ca Ca 

Since two columns of the second and third determinants on the left are 
identical, those determinants are each equal to zero and we are left with 

di da da d> da 

hi hy ha X — A* M ha ha , 

Cl Ca Ca ^*3 C2 Ca 

from which 

A?! do da 
Ic f ho ha 

Ak3 C2 C3 

x == 

di do da 

hi ho ha 

Cl Ct Ca 

To find the value of y we write down the determinant 

di {diX day daZ) da 

h, {hiX + hoy+haz) 63 , 

Cl {CiX Cay + CaZ) Ca 

replace the elements in the second column by fci, ka, ka from (1), and then 
proceed as in finding x. The result is 

fli ki da 

h\ ko ha 

Cl ka Ca 
a, dj da 

hi ha ha 

Cl Co C3 
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To find z we start with the determinant 

ai {a^x a2y + a^z) 

62 {h^x + h.y + h^z) , 
c-i Cj (c,x + c^y + Csz) 

and proceed as in the case of x. This gives 

a., Jci 

hi &2 ^2 

Cl C2 

z == • 

Cii Cl-* (I3 

hi 62 63 

Cl C._» C3 

Note that the iiuemrators of the fractions giving x, y, and z are the 
same as the denominator except that the coefficients of the desired unknown 
are replaced by the known quantities (the A:'s). Hence Cramer’s rule 
may be stated as follows: 

Write down the deierminant of the coefficients of the unknowns. Any 
unknown is equal to the fraction whose denominator is the determinant of 
the coefficients and whose numerator is the same determinant with the 
coefficients of the desired unknown replaced by the known (constant) terms. 

Cramer’s rule holds for systems of any number of equations in the 
same number of unknowns and can be derived as was done above in the 
case of three equations. 


Example. Find y from the equations 


(A) 


3j- + 2y— t — 1 

X — y — 22; -j- 4 / = 3 
2.r + 3y-f z~2t = — 2 
ri^r~2y -\-3z + 2t — 0. 


Solution. The denominator of the fractions for all the unknowns is 




640 + ; rO + 880 + 25 — 560 ) = 50. 
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Hence 


3 

1 

— 1 

1 


8 

— 5 

11 

1 ' 

1 

3 

— 2 

4 

1 

— 8 

5 

— 8 

2 ' 

1 

— 2 

1 

— 2 

9 

— 5 

14 

1 

5 » 

1 

0 

3 

2 






50 50 


The other unknowns are found to be x=—, z = , t = 0. It will 

50 50 

be found on substitution that these values satisfy equations (A). 

Although Cramer’s rule is simple and easy to apply, its use requires a 
great deal of labor when the number of equations exceeds four or five, 
because of the labor in evaluating the determinants involved. 


II. SOLUTION BY SUCCESSIVE ELIMINATION OF THE UNKNOWNS 

Several methods have been devised for solving systems of linear equa- 
tions by successive or step-by-step elimination of the unknowns. Three 
of the most important of these methods will be explained in the following 
pages. 

156. The Method of Division by the Leading Coefficients. The simplest 
of the step-by-step elimination methods is that in which each equation is 
first divided throughout by its leading coefficient, the eqyations being 
thereby transformed into a second set in which all leading coefficients 
are unity. To complete the first step, one of the transformed equations, 
which will be called the pivotal equation ^ is subtracted from each of the 
others (if all leading coefficients are positive), thus eliminating one un- 
known from the set. If the original set contained n unknowns, the first 
step reduced it to a set in 7i — 1 unknowns. 

If the same procedure is applied to the new system in n — 1 unknowns, 
we get a third set of equations in n — 2 unknowns; and by continuing the 
process we finally arrive at a single equation in one unknown. When the 
unknown has been found from this last equation, it is substituted into the 
preceding pivotal equation. The method of back substitution is continued 
until all the unknowns have been found, the back substitutions always 
being made into the immediately preceding pivotal equations. The fol- 
lowing example should make the method clear. 
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Example, Solve the equations 

475a: — 316^ — 4072: -j- 253^ = 521 
296x — 482p — 395z + 242f = 720 
364a: — 421i/ — 643z + 342^ z= 634 
282a: — 286^ — 315a + 448/ = 266. 

Solution, On dividing each equation throughout by its leading coefficient, 
we get 

(ax ) X — 0.66527^ — 0.85684a + 0.53264/ = 1 .09685 

(a.) a; — 1.62843/ — 1.3345a + 0.81758/ = 2.4324 

(as) X— 1.15663/ — 1.7665a + 0.93958/ = 1.7418 

{a^) X— 1.0142t/ — 1.1170a + 1.5887/ r= 0.94326. 

Now taking the first of these equations as pivotal equation and sub- 
tracting it from each of the others, we get the new set 

— 0.96311/ — 0.4'; 77a + 0.28494/ = 1.3356 

— 0.49131/ — 0.9097a + 0.40694/ = 0.6450 

— 0.34891/ — 0.2602a + 1.0561/ — 0.15359. 

This completes the first step. Succeeding steps are carried out in exactly 
the same manner. 

In practice, the solution is exhibited in compact form as shown below, 
the unknowns being written at the top of the table and only the coefficients 
shown in the work. Since errors are liable to be made in the computation, 
checks are provided in each line of the table. The column headed Sum 
gives the algebraic sum of the coefficients and constant term in each 
equation. The check numbers were obtained by performing on the pre- 
vious sums the same operations (divisions and subtractions) as were per- 
formed on the corresponding previous equations. For example, the check 
number 2.5869 in row (5i ) was obtained by dividing — 2.4915 uy — 0.9631 ; 
and the check number 0.7492 in row (fea) — (5i) came from subtracting 
2.5869 from 3.3361. The truth of the checks is evident from the axioms 
that if equals are divided by equals the quotients are equal, and if equals 
are subtracted from equals the remainders are equal. Hence the sums 
should agree with the check numbers in the same row. 
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X 

y 

z 

t 

c 

Sum 

Check 


475 

—310 

—407 

253 

—521 

—510 



290 

—482 

—395 

242 

—720 

—1059 



304 

—421 

-043 

342 

—634 

—992 



282 

—280 

—315 

448 

—260 

—137 


(a,) 

1 

— 0.00527 

—0.85684 

0.53264 

—1.09685 

—1.08632 

—1.0803 

(a,) 

1 

—1.0284 

—1.3345 

0.81758 

—2.4324 

—3.5777 

—3.5778 

(a.) 

1 

—1.1506 

—1.7065 

0.93958 

—1.7418 

—2.7253 

—2.7252 

(a*) 

1 

—1.0142 

—1.1170 

1.5887 

—0.94326 

—0.4858 

—0.4858 



—0.9631 

—0.4777 

0.28494 

—1.3356 

—2.4915 

—2.4914 

(a,)-(a,) 


—0.4913 

—0.9097 

0.40694 

—0.6450 

—1 0391 

—1.6390 



—0.3489 

—0.2602 

1.0561 

0.15359 

0.6006 

0.6005 

(6.) 


1 

0.49601 

—0.29580 

1.3868 

2.5809 

2.5869 

(K) 


1 

1.8510 

—0.82828 

1.31284 

3.3361 

3.3362 

(6.) 


1 

0.74578 

—3.0269 

—0.44021 

—1.7213 

—1.7214 




i.3.>r>o 

—0.53242 

—0.0740 

0.7492 

0.7492 




0.24977 

—2.7310 

—1.8270 

—4.3082 

—4.3082 

(Cx) 



1 

—0.39270 

—0.05459 

0.55205 

0.55207 

(Ca) 



1 

—10.934 

—7.3148 

- 17.249 

—17.249 

(Ca)-(CJ 




—10.541 

—7.2002 

—17.801 

—17.802 

Having reduced the 

given system to the 

single equation 



we find 


— 10.541 f — :. 2602 = 0, 


— 0.68877. 


Now substituting this value of i into (Ci), we have 


whenee 


2 — 0.30276 (— 0.68877 ) —0.05459 = 0, 
2 ==—0.21593. 


On substituting into {by) the.se values of t and z, we find 

y= — 1.4835. 

Then these known values are substituted into (rti) to find 


x = 0.29177. 

As a final check we substitute the above values of x, y. 2, and t into the 
original equations and find that the left members become 520.99, 720.01, 
634.02, and 266.02, respectively. The discrepancies are thus only — 0.01, 
0.01, 0.02, and 0.02, respectively. 



628 


SOLUTION OF SIMULTANEOUS LINEAR EQUATIONS [Chap. XVIII 


157. The Method of Gauss. In the Gauss method of solving simul- 
taneous linear equations, as explained in detail and with great clarity by 
Encke,* the imknowns are eliminated successively by solving some equation 
for one unknown in terms of all the others; then substituting this value 
for the same unknown in all the remaining equations, thereby eliminating 
the unknown from the set. The process is repeated on the new set ,of 
equations, thus eliminating another unknown; and so on until the system 
is reduced to a single equation in one unknown. 

The equations which express one unknown explicitly in terms of all the 
others are called pivotal equations. After one unknown has been found, 
the remaining unknowns are found by back substitution into the pivotal 
equations. 

In the solution of numerical equations by Gauss’s method, one should 
always select as pivotal equation the equation which has the largest coeffi- 
cient of the unknown it is desired to eliminate. For example, if the 
unknowns are to be eleminated in the order Xy y, z, (or Xiy X 2 y Xg,), the first 
pivotal equation is obtained by solving for x that equation which has the 
largest ^-coefficient. Then the second pivotal equation is obtained by 
solving for y that equation (in the new set) which has the largest y-coeffi- 
cient, etc. A slightly better result may be obtained by disregarding the 
order of elimination and solving, at each step in the elimination process, 
the equation in which the largest coefficient in the entire set occurs, this 
equation being solved for the unknown to which the largest coefficient is 
attached. The reason for preferring the largest coefficients will appear 
later. The following example illustrates the Gauss method. 

Example, Solve the following set of equations by Gauss’s method, 
assuming that the coefficients and known terms are exact numbers: 

(1) 2.63x + 5.21y — 1,6942 + 0.938< — 4.23 = 0 

(2) 3.16a: — 2.95y + 0.8132 — 4.21< + 0.716 = 0 

(3) 5.36x + 1.88y — 2.152 —4.95^ —1.28 =0 

(4) 1.34x + 2.98y — 0.4322 — 1 .768< — 0.419 = 0. 


Solution, The variables will be eliminated in the order Xy y, 2 , t. Since 
the largest coefficient of x occurs in (3), we take that as the pivotal equa- 
tion. Solving it for x, we get 


( 5 ) 


_ 1.88 2.15 ^ , 4.96 1.28 

” 5.36 ^ 5.36 ^ 6.36 ^ 5.36 

= — 0.350746y -f 0.40111 Oz -f- 0.923506/ + 0.238806. 


* Berliner Aetronomischee Jahrbuch: 1835, pp. 267-272; 1836, pp. 266-269. 
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Substituting this value of x into (1), (2), and (4), and reducing^ we get 

(6) 4.287538y — 0.639062; +3.36682^ —3.601940 = 0 

(7) — 4.05836y +2.080542; —1.29172^ +1.470627 = 0 

(8) 2.610000y + 0.1056002 — 0.530500< — 0.099000 = 0. 

Since (6) has the largest y-coefficient, we solve it for y and get 

(9) y = 0.1490512 — 0.785258< + 0.840096. 

Substituting this value of y into (7) and (8), we get 

(10) 1.475642 + 1.89514< —1.93879 = 0 

(11 ) 0.4796182 — 2.501500^ + 2.00964 = 0. 

Here we take (10) as the pivotal equation and get 

(12) 2 = — 1.28428^ + 1.31386. 

Substituting this value of z into (11), we get the final equation 

(13) — 3.11 7463f + 2.63979 = 0, 
from which i = 0.846775. 

The values of z, y, and x are found by back substitution into (12), (9), 
and (5), respectively. Substituting the value of t into (12), we find 

2 = 0.22636. 

Then substituting the values of t and z into (9), we find 

y = 0.208898. 

Finally, on substituting the values of z, and y into (5), we get 

a: = 1.038335. 

The solution of the given system of equations is thus 

X = 1.038335 
y = 0.208898 
2 = 0.22636 
t = 0.846775. 

When these values are substituted into the original equations (1), (2), 
(3), (4), the left members of those equations have the values 0.00000, 
0.00000, 0.00001, 0.00000, respectively. 
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It will be observed that the Gauss method reduced the original system 
of equations to the triangular system of pivotal equations: 

5.36a; + 1.88y — 2.15z — 4.96« _ 1.28 = 0 

4.287538y — 0.63906z + 3.36682« — 3.601940 = 0 

1.47564z+ 1.89514« — 1.93897 =0 

— 3.117463^ + 2.63979 =0. 

Since the value of the determinant of the coefficients in the given system 
is equal to the product of the leading coefficients in the triangular system 
(Art. 154), we have 

A= (5.36) (4.287538) (1.47564) (—3.117463) = — 105.720. 


158. Another Version of the Gauss Method. If we apply the method 
of the previous article to the equations 


(1) 


'■ 

aiX + a 2 y + a^z = ki (a) 

^ hyX + hzy + 63Z = IC2 (b) 

CxX + Czy + CzZ = ^3 (c) 


and assume that is larger than either 61 or Ci, we take (a) as the pivotal 
equation and solve it for a:, obtaining 


X = 


h. 





Z. 


On substituting this into (b) and (c), we get 


( 2 ) 


{b2 — -a,)y+{h,—^a,)z = k,~^k, (d) 

(l\ di fll 

(C 2 — — 02)y+(c3 — —a»)z = ks — — k,. (e) 

Oi\ fli fli 


Equations ( 2 ) are exactly what would have been obtained if we had 

5 c 

multiplied ( 1 ) (a) successively by — and — and then subtracted the 

(i\ (ii 


resulting equations from ( 1 ) (b) and ( 1 ) (c), respectively. Equations ( 2 ) 
will also be obtained if we first divide ( 1 ) (a) throughout by Ui, then 
multiply the resulting equation successively by hi and Ci, and then subtract 
these resulting equations from ( 1 ) (b) and ( 1 ) (c), respectively. The 
Gauss method is therefore equivalent to either of the following procedures : 
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1. Choose the pivotal equation just as in Art. 157. Multiply this pivotal 
equation successively by such positive numbers as will make its leading 
coefficient in each case numerically equal to the leading coefficients of the 
other equations of the set. Then subtract the multiplied pivotal equations 
from the other equations having the same leading coefficients, thereby 
eliminating one unknown completely. Follow the same procedure with 
the new equations in n — 1 unknowns. Or: 

2. Divide the pivotal equation throughout by its leading coefficient. 
Then multiply the resulting equation successively by the leading coefficients 
of the other equations and subtract the multiplied pivotal equations from 
the other equations having the same leading coefficients. Follow the same 
procedure with the new set in r? — 1 unknowns. 

In case the leading coefficients in some of the other equations are negative 
(or have signs opposite that of the leading coefficient of the pivotal equa- 
tion), the multiplied pivotal equations are added to the other equations 
instead of subtracted from them. 


Example. Solve the equations 

2.63J 4- 5.21i/ — 1.694^ + 0.938/ — 4.23 = 0 (a) 

3.16^-2.951/4-0.8132 — 4.21/ 4 0.716 = 0 (b) 

“ :).36j4-1.88y — 2.152 —4.95/ —1.28 -0 (c) 

1 .34j: + 2.98y — 0.4322 — 1 .768/ — 0.41 9 = 0 (d) 

by the first nicThod stated above. 

Solution. We take (c) as the pivotal equation and multiply it suces- 

sively bv — ^ thereby obtaining the equations 

*' 5.3() 5.36 5.36 


(B) 


' 2.63J- -r 0.92246y — 1.054 942 — 2.42882/ — 0.62 806 = 0 
. 3.1 6x + 1 .10836)/ — 1 .267542 — 2.91 828/ — 0.754627 = 0 
1 .34x + 0.47000)/ — 0.537502 — 1 .23750/ — 0.32000 = 0. 


Now subtractiiiff the first of the.se equations from (a), the second from (b), 
and the third from (d). we get 


' 4.28754y — 0.639062 + 3.36682/ — 3.60194 = 0 

(C) . —4.05836y + 2.080542 — 1.29172/ + 1.47063 = 0 

2.51000J/ + 0.105502 — 0.53050/ — 0.09900 - 0. 

These equations are the same as (6), (7), (8) of Art. 157. 
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The computation is usually presented in tabular form as given below : 


w 

y 

z 

t 

k 

Sum 

Check 

2.63 

5.21 

—1.694 

0.938 

—4.23 

2.854 


3.16 

—2.95 

0.813 

—4.21 

0.716 

—2.471 


6.36 

1.88 

—2.15 

—4.96 

—1.28 

—1.14 


1.34 

2.98 

—0.432 

—1.768 

—0.419 

—1.701 



4.28764 

—0.63906 

3.36682 

—3.60194 

3.41336 

3.41337 


—4.05836 

2.08054 

—1.29172 

1.47063 

—1.79891 

—1.79891 


2.51000 

0.10550 

—0.53050 

—0.09900 

1.98600 

1.98600 



1.47564 

1.89514 

—1.93879 

1.43199 

1.43200 



0.47962 

—2.50150 

2.00964 

—0.01224 

—0.01224 




—3.11747 

2.63979 

—0.47768 

—0.47767 


From the last equation we find 

_ 2.63979 
^“3.11747 


0.846773. 


Back substitution into the other pivotal equations gives 


2 0.22637 

y = 0.208901 
X = 1.03834. 


When these values are substituted into the given equations, the left members 
of those equations become 0.00001, 0.00000, 0.00000, and 0.00001, respec- 
tively. The slight discrepancies between the results found above and those 
found in Art. 157 are due to the fact that some of the numbers in the 
above table were rounded off to the same number of decimal places as 
some other numbers to which they had to be added to obtain the ^‘sums.” 

The numbers in th check column were obtained from the sums ” found 
in the preceding sets of equations, by applying to those sums the same 
operations as were applied to the pivotal equations. For example, the 
check numbers 1.43200 and — 0.bl224 were obtained as follows: 


— 1.79891 + X 3.41336 = 1.43200 

1.98600 — X 3.41336 = — 0.01224. 

4./&o7o4 

In case a check number fails to agree with the sum immediately to the 
left of it, a mistake has been made in the computation and should be 
found and corrected at once. 
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If we wished to solve the given set of equations by the second method 
outlined above, we would first divide equation (c) throughout by 6.36, 
thereby obtaining the pivotal equation, 

X + 0.360746y — 0.4011 19^ — 0.923506^ — 0.238806 = 0. 

Then we would multiply this equation successively by 2.63, 3.16, and 1.34. 
The resulting equations would then be subtracted from (a), (b), and (d), 
respectively, thus obtaining equations which should agree with equations 
(C). The solution would be continued by dividing the first of the new 
equations throughout by 4.28754 to get a new pivotal equation, etc. After 
finding t, we would find the other unknowns by back substitution into the 
pivotal equations. As a final step, we would substitute the computed values 
of X, y, Zy and t into equations (A) as a check. 

We may now state the reason for choosing as pivotal equations those 
equations having the largest coefficients of the unknowns we desire to 
eliminate. A glance at equations (2) shows that fractional terms are 
present in the coefficients and in the constant terms. It is desirable that 
such fractional terms be as small as possible, and this necessitates that the 
denominator Ui be as large as possible. Moreover, if the numerators of 
such fractions contain rounding errors, the effects of such errors are 
diminished when the denominator Uj is large. 


III. SOLUTION BY INVERSION OF MATRICES 

169. Definitions. A matrix is a rectangular array of quantities or 
numbers, such as 

U1U2USU4 


To distinguish such an array from a determinant, which it resembles in 
appearance, it is always enclosed by square brackets, large parentheses, or 
double bars, as: 

axa2(i^(iA /aia2asa4\ aia2a2a^ 

C1C2C8C4 \CiC 2 CzC^/ C1C2C8C4 

We shall use the square-bracket notation and write a general matrix in 
the form 
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■ 0>\n 

021022^28 ’ 

• ‘(l2n 

®8lO'32®Sa * 

* ttsw 




The quantities Un, ai 2 , etc., are called the elements of the matrix, as in 
the case of determinants. It is to be noted that the first digit in the 
double subscript of an element denotes the row and the second digit 
denotes the column in which the element stands. A matrix of m rows 
and n columns is an m X matrix. 

If m = n, the matrix is a square matrix of order n. 


A matrix may consist of only a single column, as 


tti 

0/2 

0/3 

^4 


in which case it is called a column matrix. It is merely a special case of 
a general matrix. 

If all the elements in the leading diagonal of a square matrix are unity 
and all the other elements are zeros, the matrix is called a unit matrix. 
Thus, 

"“1 0 0 0 “ 

0 10 0 
0 0 10 
_0 0 0 1 _ 

is a unit matrix of the fourth order. A unit matrix of any order will be 
denoted by the symbol 7. Unit matrices play an important role in the 
application of matrices. 

If all the elements of a matrix are zero, the matrix itself is zero. 
Although the elements of a matrix are numbers, the matrix itself is not 
a number. It plays the role of an operator, as we shall see later. 


160. Addition and Subtraction of Matrices. Two matrices of the 
same order can be added or substracted by adding or subtracting their 
corresponding elements. Thus, the sum of the two matrices 



Audi 2^13 


&1i6*12&13 

A = 

^21^22^28 

and B 

&21^22&28 


®3X®82®33 


^31^32^38 
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is the matrix 


flu -|- hii ai2 -f- hi2 fli8 “f" &18 

0 = flai -|- 621 fl22 “h &22 fl23 "i" ^28 

^31 4“ &ai fl32 4“ &82 flaa + ^aa 


We therefore write 


A +B = C. 


The difference of two matrices is found in the same manner, and we 
therefore write 

where the elements of C" are those of C with the signs of the t’s changed. 
Examples : 

r2 3 — 4 i r 1 — 2 4i fs 1 on 


3 —2 


0 = 2—1 


161. Multiplication of Matrices, a) Multiplication of a matrix by a 
simple number or scalar. To multiply a matrix by a number or scalar 
quantity, we multiply every element of the matrix by that number. For 
example, 

rtiflufla « 

^ 6162&3 J _mbi mhn mb^ ^ 

To see the reason for this rule of multiplication, let us consider the sum 
of three matrices of the second order, 


a+b+c= 


C,iCr, 

C'JiCon 


Let us suppose now that the three matrices become identical, so that 
B = C = A and fc„ = c™ = flr,- Then we have 

3fli i3fli 2 

~ _302i3a.s_ ’ 

and so in general. 

Note that this multiplication differs from the multiplication of a deter- 
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minant by a scalar, for in the latter case the elements of only one row or 
column are multiplied by the scalar. 

b) Multiplication of a matrix by another matrix. In the system of 
equations 

aiXi “I” (12^0 -|- flag's — Atj 

( 1 ) ^ biXi & 2^2 ” 1 " b^x^ ]C‘t 

C2X2 "4” CgX^ — 

the array 

bib2b2 

CiC2C^ 


is called the matnx of the coefficients. This matrix may be regarded as 
an operator which operates on the ar’s to produce the /c’s on the right side 
of the equations. The operation is seen to be a type of multiplication. 
If the x’s be arranged in a vertical column, as 

X2 

Xzy 

the left member of the first equation of (1) is seen to be the sum of the 
products of the elements of the top row of the coefficient matrix by the 
corresponding x's in the vertical column. The left members of the other 
equations can be obtained in the same manner. We are therefore justified 
in writing (1) in the form 



With (2) as a starting point we utilize a linear transformation to derive 
the rule for the multiplication of matrices in general. 

Consider the two systems of equations 


( 3 ) 
and 

(4) 


X I 

{ yi = “h “h I” <*11^12^13 ”1 yi 

y2 ^ a2lXi “I" ^22^2 "I" ^23^3' j^fl2lfl22^23 ^ ^2 

= ^11^1 ”t" bioy_. biihi2 _ Zi 

■•22“ ^21^1 ^ 223^2 or b^ihji I = ^2 • 

2s = 632y2> _b'A\b:\2 
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Eliminating and yg by substituting in (4) their values as given in (3), 
we get 

Zi = (biiaii -1- 612^21)^1 -|- (2>iifli2 ^12^22)^2 "i” “1“ ^12628 )3?8 


Z2 ( 2 > 21®11 ” 1 “ 2^22^21)^1 “I" (&2lfll2 “f" & 22 < 3^22 ) i*^2 "|“ (&2lfll8 ”f" 622^28)^8 

23 = (2^81^ 11 “1“ 2>32®2i)^ 1 ”h (2>81 <Ii 2 “t" hs20'22)^2 "1“ (2>31®18 “f” ^32(^2»)x» 9 


OTy in matrix form^ 


611 ®!! 4 “ 612^21 

611 U 12 4 “ 612 U 22 

6 iifli 8 4 " 6 x 2^28 




62 x^ 11 4 " 622^21 

621^12 4 “ 622 U 22 

62 x ^18 4 “ 622^28 


= 

Z2 

_ 4 “ 632^21 

631^12 4 “ 632 U 22 

63 x ^18 4 ” 632^28 __ 

I 




Now replacing the column matrix 
(3), we get 



(7) 


611612 

621622 

631632 


flll®12®l8 

021^22^28 


of (4) by its value as given 


3^2 

Xs 


Z2 

Z3 


in 


Comparison of the left members of (6) and (7) gives the relation 


( 8 ) 


611612 

1 — — 1 

I 011 ^ 12^18 

621622 

1 (l 2 lQ> 22^22 _J 

__ 631632 _ 


611U11 -|“ 6i2a2i 
621^^11 ”1" 622^21 
631011 “f” 632021 


611O12 H” 6i2fl-22 
621012 "f” 622022 

6 siOi 2 “4" 632 O 22 


611O13 “1“ 612O28 
621O18 4“ 622O28 
631013 “h 632O28 _ 


Formula (8) expresses the rule for the multiplication of matrices. If 
the first of the two matrices in the left member of (8) be denoted by B 
and the second by a glance at (8) shows that the elements in the 
product matrix in the right member can be obtained by following the 
procedure outlined below. It is best to compute the product by columns; 
that is, compute one column at a time, beginning with the first. 


First column of product: 

To find the iirst element in the first column of the product, multiply the 
elements in the first row of B into the corresponding elements in the first 
column of A and sum the products thus obtained. To find the second 
element in the first column of the product, multiply the elements in the 
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second row of B into the corresponding elements in the first column of A 
and sum the products thus obtained. The third element in the first column 
of the product is found by multiplying the elements in the third row of B 
into the corresponding elements in the first column of A, and so on for 
the remaining elements in the first column of the product. 

Second column of product: 

To find the first element in the second column of the product matrix, 
multiply the elements in the first row of B into the corresponding elements 
in the second column of A and sum the products thus obtained. To find 
the second element in the ^second column of the product, multiply the 
elements in the second row of B into the corresponding elements in the 
second column of A and sum the products thus obtained. The remaining 
elements in the second column of the product are found in a similar 
manner. 

Third column of product: 

Proceed as for first and second columns, except that the elements in 
the rows of B must be multiplied into the corresponding elements in the 
third column of A. 



(a) Rows are always multiplied into columns. 

(b) The number of rows in the product is the same as the number of 
rows in B, and the number of columns in the product is the same 
as the number of columns in A, 


(c) The number of rows in one factor must be the same as the number 
of columns in the other factor. 
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If -4 and B denote any two matrices and C denotes the product AB, 
then 

ABzizC. 

But BA ^ C, in general. 

That is, matrix multiplication is not commutative in general. For 
example, 

but 

r ] 4nr2 31 r 22— in 

L — 3 — 2 JL 5 — iJ-L_16 

an entirely different result. 

An important exception occurs in the case of the product any matrix 
by a unit matrix. For example, 


and 


hyh.J), 

C 1 CoC^ 


”1 0 0 “ 
0 10 
0 0 1 



a, + 0 -j- 0 

0 -f a, + 0 

0 -|“ 0 -|“ fls 



= 

^, + 0 + 0 

0 + h. + 0 

0 + 0 + 63 

= 



_r,+0 + 0 

0 + c, + 0 

0 + 0 + C3 _ 


_ _ 


"10 0“ 


0 1 0 


_0 0 1 _ 

_ CiC,Ca _ 


+ 0 + 0 

fl _» -j- 0 -f- 0 

fls 0 -j- 0 


~a^axl t “ 

0 + 6, + 0 

O + b. + O 

0 -f 63 + 0 

= 

bibJ), 

_{) + 0+ r, 

0 + 0 + c. 

0 + 0 -j- C;t _ 


_ CjCjCt _ 


which is the same result in both cases. 

It is to be noted that the multiplication of a matrix by a unit matrix 
does not change its value. More generally, 


AI = Ar- = ‘ • =AI^ = A. 


In the j)roduct AB — (\ B is said to be /;remulti})lie(l by A ; whereas in 
the product BA = I), B is said to be po5/multiplied by A. Because matrix 
multiplication is not commutative in general, premulti})lication and post- 
multiplication do not give the same result in general. 
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The multiplication of one matrix by another is a most important process 
and should be thoroughly learned and kept in mind by everybody who works 
with matrices. It is used constantly in checking the inversion of matrices. 

162. Inversion of Matrices. The operation of dividing one matrix 
directly by another does not exist in matrix theory, but the equivalent of 
division can be accomplished in most cases by a process called the inversion 
of matrices. The inverse of a square matrix A is another square matrix 
A"^ of the same order, such that 

(1) AA-^ = /, 

where I denotes a unit matrix of the same order. Moreover, it can be 
shown that 

A-U = /, 

so that 

AA-^=:A'>A. 


Hence a matrix is commutative with its inverse. 
A“' when A is given is called the inversion of A. 
find A‘^, we digress for a moment to consider the 
its existence. 

If A denotes any square matrix such as 


The process of finding 
Before showing how to 
condition necessary for 


the determinant 


A = 




CiC,C3 


Ml = 


(1^(12(13 


C1C2C3 


is called the determinant of the matrix. If the determinant of a matrix 
is not zero, the matrix is said to be non -singular and can always be inverted. 
That is, if j A |^0, A*^ can always be found. The reason for this is 
as follows: 

It is shown in most books dealing with matrix theory that 


•^1 

1^1 

B. 

1^1 

Cr -] 

\A\ 


~Ar 

B. 

cr 

^2 

B* 

(^2 

1 

At 

B* 

Ct 

1 09 

1^1 

B, 

A 

1 

~ |4| 


B, 



( 2 ) 


A-^ = 
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where B 2 , etc., are the cofactors of the elements ai, ho, etc., in the 
determinant \A\. Evidently A'^ could not exist if | A | = 0. 

Several methods have been devised for finding the inverse of a matrix. 
It can be found, for example, by means of formula (2). Although (2) 
is of value theoretically, it is of little value in the inversion of numerical 
matrices, because of the large number of determinants (the cofactors) 
that must be evaluated. The method of inversion explained below is 
simple, direct, and reasonably short.* By a procedure similar to the Gauss 
method explained in Art. 158, the given matrix is transformed into its 
inverse by means of a unit matrix of the same order. The transformation 
is made in consecutive steps, the number of steps being equal to the order 
of the matrix. A single column of the unit matrix is used in each step. 
The aim in each step is to reduce to zero all the elements in the first 
column except one, and that element is reduced to unity by dividing its 
row throughout by such a number as will make it unity. The matrix at 
the beginning of each step is augmented by the appropriate column of the 
unit matrix, and all elements in each row of the augmented matrix are 
subjected to the same operations. The underlying theory of this method 
of inverting matrices will not he given. The fact that the method always 
gives the correct result is a sufficient indication of its soundness. The 
simplest case of the method and a more general case will be explained by 
means of examples. The first element in the pivot line of every matrix 
will be in bold type. 


a) The simplest case. 


Example 1. Find the inverse of the matrix 


A = 



3 

1 



Solution. The given matrix is first augmented by inserting the first 
column of a unit matrix of the third order, as follows; 



This method is ueed at the National Bureau of SUndarde and perhaps elsewhere. 
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The first row is then divided throughout by 2 , giving 

1—1 2 ; 1 / 2 "' 

2 3 2 ; 0 . 

_ — 1 1 —1 ; 0 

We now multiply the first row by 2 and subtract the result from the second 
row, and we also add the first row to the third row, thereby obtaining 


1 

— 1 

2 

1/2 ~ 

0 

5 - 

-2 

— 1 

0 

0 

1 

1/2 _ 


This ends the first step of the transformation. 

To start on the second step, we discard the first column of the old 
matrix and augment the last three columns by the second column of the 
unit matrix. Thus, 


— 1 

2 

1/2 

0 

5 

— 2 

— 1 

1 

0 

1 

1/2 ; 

0 


We now divide the second row throughout by 5 and add the result to the 
first row, thus obtaining 

"“O 8/5 3/10 ; 1/5"" 

1 — 2/5 —1/5 ; 1/5 . 

0 1 1/2 ; 0 _ 

This ends the second step. Note that nothing was done to the third row, 
because its element in the first column was already 0. 

We begin the third and last step of the transformation by discarding the 
first column of the matrix just found and then augmenting the remaining 
columns by the third column of the unit matrix. Then we have 


8/5 

3/10 

1/5 

0 

— 2/5 

— 1/5 

1/5 

0 

1 

1/2 

0 

1 


Now multiply the third row by 8/5 and subtract the result from the first 
row, and also multiply the third row by 2/5 and add the result to the 
second row. This gives 


0 

— 1/2 

1/5 

— 8/5 

0 

0 

1/5 

2/5 

1 

1/2 

0 

1 



Abt. 162] 


INVERSION OF MATRICES 


643 


This ends the third step of the transformation. On dropping the first 
(!olunm of the matrix just obtained, we have 

“ — 1/2 1/5 — 8 / 5 ” 

0 1/5 2/5 . 

1/2 0 1 

as the inverse of the given matrix. 

Since mistakes are easily made in the transformations, we check the 
result by seeing whether the inverse premultiplied by the given matrix 
gives the unit matrix. We therefore have 


" 2 

— 2 

4 ' 


-— 1/2 

1/5 

— 8/5~ 

2 

3 

2 

X 

0 

1/5 

2/5 

_— 1 

1 

— 1 _ 


1/2 

0 

1 



-— 1 + 0 + 2 

2/5 — 2/5 + 0 

— 16/5 — 4/5 + 4“ 


“1 0 0” 

== 

-1-1-0+ 1 

2/5 -f 3/5 + 0 

— 16/5 + 6/5 +-2 

= 

0 10 


_ 1/2 +0 — 1/2 ■ 

- 1 / 54 - 1/5 + 0 

8/5 + 2/5 — 1 _ 


_0 0 1_ 


The inverse found is therefore correct. 


Example 2. Find the inverse of the matrix 
'2 —2 0 —1 


2 1 2 
-2 3 —2 

1 2 2 


Solution. Tlie steps in the solution are shown below. 


“2 

2 

0 

— 1 

' 1 “ 


-1 

— 1 

0 

— 1/2 ; 1 / 2 “ 

0 

2 

1 

2 

' 0 


0 

2 

1 

2 • 0 

1 

1 

— 2 

3 

— 2 

' 0 


1 

9 

3 

— 2 ' 0 

1 

0 

1 

2 

2 

i 


0 

1 

2 

2 ; 0 j 


Subtract row 1 from row 3 

-1 _1 0 — 1/2 
0 2 1 2 

0—1 3—3/2 

0 1 2 2 


Then we have 


1 / 2 - 

0 

— 1/2 
0 


End of ste}) 1 


-1 0 — 1/2 1/2 

2 12 0 

-1 3 —3/2 —1/2 

12 2 0 


0“ 


“ — 1 

0 

— 1/2 1/2 

0 “ 

1 


1 

1/2 

1 (i 

1/2 

0 


— 1 

3 

— 3/2 — 1/2 

0 

0 


1 

2 

2 0 1 

' 0 
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Add row 2 to rows 1 and 3 and subtract it from row 4, obtaining 


0 1/2 

1/2 


1/2 ; 

1/2 








1 1/2 1 

0 7/2 —1/2 



0 ' 

1/2 ; 

1/2 

1/2 


End of step 2 




0 3/2 

1 


0 ; — 

1/2 

_ 







1/2 

1/2 

1/2 

1/2 

0“ 



1/2 

1/2 

1/2 

1/2 

0 

1/2 

1 

0 

1/2 

0 



1/2 

1 

0 

1/2 

0 

7/2 — 1/2 — 

1/2 

1/2 

1 



Vi 

— 1/14 

— 1/14 

1/14 

1/7 

3/2 

1 

0 

— 1/2 

0 



3/2 

1 

0 — 

1/2 

0 


Subtract row 3 from rows 1 and 2, and subtract three times row 3 from 
row 4. The result is 


" 0 

4/7 

4/7 

3/7 

— 1/1" 

0 

15/14 

1/14 


— 1/1 


— 1/14 

— 1/14 

1/14 

1/1 

_ 0 

17/14 

3/14 - 

- 5/1 

— 3/1 _ 




-0 

4/1 4/1 

3/7 

; —1/7’’ 




0 

15/14 1/14 

3/7 

I — 

End of 



1 

— 1/1 —1/1 

1/7 

' 2/r 

1 





11/14 3/14 

— /j 

/'7 

I —3/1 _ 


4/1 

4/ 


3/1 —1/1 ; 

on 




15/14 

1/14 

3/1 —1/1 ; 

0 




— 1/1 - 

-1/ 

7 

1/1 2/1 ; 

0 




17/14 

3/14 

— 5/1 —3/1 ; 

1 _ 







4/1 4/1 

3/1 

— 1/1 ; 

0 " 




15/14 1/14 

3/1 

— 1/1 ; 

0 



- 

-1/1 —1/1 

1/1 

2/1 ; 

0 




1 3/11 — 

■10/17 

— (i/ll ; 

14/17 


Multiply row 4 by 4/7 and subtract result from row 1, multiply row 4 
by 15/14 and subtract the result from row 2, and multiply row 4 by 1/7 
and add the result to row 3. The result is 


“0 

8/17 

13/17 

1/17 

— 8/17” 

0 

— 2/17 

18/17 

4/17 

— lo/i: 

0 

— 2/17 

1/17 

4/17 

2/17 

1 

3/17 

— 10/17 

— 6/17 

14/17 


End of step 4. 
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Hence 


“ 8/17 

13/17 

1/17 

— 8/17“ 


" 8 

13 

1 

— 8" 

— 2/17 

18/17 

4/17 - 

-15/17 

= 1/17 

— 2 

18 

4 - 

— 15 

— 2/17 

1/17 

4/17 

2/17 

— 2 

1 

4 

2 

3/17 - 

- 10/17 - 

-6/17 

14/17 


3 - 

-10 - 

-6 

14 


is the desired inverse matrix. Premultiplication of this by the given 
matrix will give a unit matrix of the fourth order, as the reader may verify. 


Example 3. Invert the matrix 


"1.254 

0.831 

1.109 

0.532 

1.105 

o 

o 

0.957 

1.342 

0.642 


Solution. We have 


" 1.254 

0.831 

1.109 

: n 


"1 

0.6627 

0.8844 

0.7974 " 

0.532 

1.105 

0.702 

: 0 


0.532 

1.105 

0.702 

0 

0.957 

1.342 

0.642 

I 


0.957 

1.342 

0.642 

0 


where we have divided row 1 by 1.254. Now multiply row 1 of the matrix 
on the right by 0.532 and subtract the result from row 2, and also multiply 
row 1 by 0.957 and subtract the result from row 3. We thus get 


"1 0.6627 0.8844 

0 0.7524 0.2315 

0 0.7078 —0.2044 


0.7974“ 

— 0.4242 

— 0.7631 


End of step 1 


“0.6627 0.8844 0.7974 j 0" 

0.7524 0.2315 —0.4242 ; 1 

0.7078 —0.2044 —0.7631 ' 0 



"0.6627 

0.8844 

0.7974 : 

0 


1 

0.3077 

— 0.5638 ; 

1.3291 


0.7078 

— 0.2044 

— 0.7631 ; 

0 


Now multiply row 2 by 0.6627 and subtract result from row 1 Also 
multiply row 2 by 0.7078 and subtract result from row 3. Then we have 
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”0 0.6805 1.1710 

1 0.3077 —0.5638 

0 —0.4217 —0.3640 


— 0.8808“ 
1.3291 
— 0.9407 


End of step 2 


0.6805 1.1710 —0.8808 [ 0“ 

0.3077 —0.5638 1.3291 [ 0 

— 0.4217 —0.3640 —0.9407 • 1 



“0.6805 

1.1710 

— 0.8808 ; 

0 

= 

0.3077 

— 0.5638 

1.3291 ; 

0 


1 

0.8632 

2.2308 ; 

— 2.3714 


On multiplying row 3 by 0.6805 and 0.3077 and subtracting the respective 
results from rows 1 and 2, we get 


“0 

0.5836 

— 2.3988 

1.614 “ 

0 

— 0.8294 

0.6427 

0.7297 

_1 

0.8632 

2.2308 

— 2.3714 


End of step 3. 


The required inverse is therefore 

0.5836 —2.3988 1.614 

— 0.8294 0.6427 0.7297 

0.8632 2.2308 —2.3714 


When this is premultiplied by the given matrix, the result is 

0.9997 0.0000 0.0006 " 

— 0.0001 1.0001 0.0002 , 

— 0.0005 —0.0009 1.0014 


which is practically a unit matrix. 

b) Inversion in the more general case. In the preceding examples the 
pivot lines have been taken in consecutive order, always bginning with 
the first line of the given matrix. This procedure cannot be followed if 
the first element in the pivotal line is zero. Furthermore, if the first 
element in the pivotal line is not zero, it is sometimes desirable to take 
pivotal lines in any order. However, when the pivotal lines are not taken 
in consecutive order, the matrix obtained at the end of the last step will 
not be the desired inverse, but will be that inverse with its rows and 
columns permuted. The matrix obtained in the last step must therefore 
be unscrambled to obtain the desired inverse. The unscrambling process 
will be explained by means of an example. 
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Example -J. Find the inverse of the matrix 

“1 —2 3 4“ 

3 —1 2 5 

2 4 — 5 1 ‘ 

_4 2 — 1 3_ 

Solution. Here we take as pivotal row the one having the largest element 
in the first column : the fourth row. Augmenting the given matrijc by the 
fourth column of a unit matrix of the fourth order, we have 


“1 

— 2 

3 

4 

0“ 


“1 

— 2 

3 

4 

0 “ 

3 

— 1 

2 

5 

0 


3 

— 1 

0 

5 

0 

2 

4 

— 5 

1 

0 


2 

4 

— 5 

1 

0 

4 

2 

— 1 

3 

1 


1 

1/2 

-1/4 

3/4 

1/4 


Subtracting row 4 from row 1, three times row 4 from row 2, and twice 
row 4 from row 3, we get 


■“0—5/2 13/4 13/4 ; —1/4“ 

0 —5/2 11/4 11/4 ; —3/4 

0 3—9/2 —1/2 ; —1/2 

_1 1/2 —1/4 3/4 ; 1/4 _ 


End of step 1 


“—5/2 13/4 13/4 —1/4 

— 5/2 11/4 11/4 —3/4 

3 —9/2 —1/2 —1/2 
1/2 —1/4 3/4 1/4 


0 

0 

1 

0 


“ — 6/2 13/4 

13/4 

-1/4 

0 " 

— 5/2 11/4 

11/4 

— 3/4 

0 

1 —3/2 

-1/6 

— 1/6 

1/3 

1/2 - 1/4 

3/4 

1/4 

0 


Now adding 5/2 times row 3 to rows 1 and 2, and subtracting 1/2 of 
row 3 from row 4, we get 


“0 

— 1/2 

17/G 

— 2/3 

5/6 

0 

— 1 

7/3 

— 7/6 

5/6 

1 

— 3/2 

-1/6 

— 1/6 

1/3 

0 

1/2 

5/6 

1/3 

— 1/6 


End of step 2 
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r — 1/2 

17/6 

— 2/3 

5/6 

0 “ 

— 1 

7/3 

— 7/6 

5/6 

1 

— 3/2 

- 1/6 

— 1/6 

1/3 

0 

- 1/2 

5/6 

1/3 

- 1/6 

0 _ 


r— 1/2 

17/6 

— 2/3 

5/6 ; 

0” 

1 — 7/3 

7/6 

— 5/6 j 

— 1 

— 3/2 —1/6 

-1/6 

1/3 ; 

0 

^ 1/2 

5/6 

1/3 

— 1/6 ; 

0 


Adding 1/2 row 2 to row 1, 3/2 row 2 to row 3, and subtracting 1/2 
row 2 from row 4, we get 


0 5/3 — 1/12 

5/12 

: - 1 / 2 "' 




1 — 7/3 7/6 

0 — 11/3 10/12 

— 5/6 
— 11/12 

1 — 1 
i — 3/2 

End of step 3 


0 2 — 1/4 

1/4 

: V 2 _ 




5/3 — 1/12 

5/12 — 

1/2 ; in 




— 7/3 7/6 - 

- 5/6 - 

-1 ' 0 

1 




— 11/3 19/12 — 

11/12 — 

3/2 ; 0 




2 — 1/4 

1/4 

1/2 ; o _ 





1 

— 1/20 

1/4 

— 3/10 

3/5 - 


— 7/3 

7/6 

— 5/6 

— 1 

0 


— 11/3 

19/12 - 

- 11/12 

— 3/2 

0 


2 

— 1/4 

1/4 

i /2 

0 


Now add 7/3 of row 1 to row 2 and 11/3 of row 1 to row 3. Also subtract 
twice row 1 from row 4. Then we have 


”1 —1/20 

1/4 

— 3/10 ; 

3/5 ~ 

0 21/20 

— 1/4 

— 17/10 ; 

7/3 

0 7/5 

0 

— 13/5 ; 

11/5 

0 —3/20 

— 1/4 

11/10 ' 

— 6/5 


Hence the permuted inverse is 


— 1/20 1/4 —3/10 3/3” 

21/20 —1/4 —17/10 7/5 

7/5 0 —13/5 11/5 

— 3/20 —1/4 11/10 — C/5_ 
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To unscramble this matrix, we first permute its rows and then permute 
the columns of the resultant matrix. In order to make the permutations 
in a systematic and infallible manner, we construct a table showing the 
pivotal row used in each step of the transformation. The table for the 
present example is: 

Steps: 1 2 3 4 (for rows) 

Pivot rows: 4 3 2 1 (for columns). 

The use of this table is as follows: To find the roms in the first per- 
muted matrix, we fix our attention on the numbers in the top row of the 
table and note the number directly under any particular number. For 
example, the number directly under 2 in the top row is 3, and this means 
that row 2 of the new matrix will be row 3 of the previous matrix (the 
scrambled inverse found in the last step of the transformation). 

To find the columns in the final inverse matrix, we fix our attention 
on the numbers in the bottom row of the table and note the number directly 
over any particular number. For example, the number directly over 1 in 
the bottom row is 4, and this means that column 1 in the final matrix is 
column 4 of the previous matrix (the one having the unscrambled rows)* 
We now proceed to unscramble (A), first unscrambling the rows. 

To find row 1 of the next matrix after (A), we look for 1 in the top 
row of the table and find that the number immediately under it is 4. 
Hence row 1 of the new matrix is row 4 of (.\). Likewise, under 2 of the 
top row we find 3 and therefore row 2 of the new matrix is row 3 of (A). 
The remaining rows of the new matrix are found m the same manner 
and we therefore get the matrix 

“_3/20 —1/4 11/10 — G/o- 

7/5 0 —13/5 11/5 

^ ^ 21/20 —1/4 —17/10 7/5 

_— 1/20 1/4 —3/10 3/5 _ 

We now unscramble the columns bv applying the table to (B). To find 
column 1 of the final inverse matrix, we look for 1 in the bottom row of 
the table and find 4 immediately above it. Collimn 1 of the inverse is 
therefore column 4 of (B). To find column 2 of the inverse, we look for 
2 in the bottom row of the table and find 3 immediately above t. Column 
2 of the inverse is therefore column 3 of (B). The remaining columns 
are found in the same manner and we thus get 
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"—6/5 11/10 —1/4 —3/20" 

11/5 -13/5 0 7/5 

^ ^ 7/5 —17/10 —1/4 21/20 ’ 

3/5 —3/10 1/4 — 1/20_ 

as the desired inverse matrix. The reader will find that if (C) be multi- 
plied by the original matrix the result will be a unit matrix of the fourth 
order. That shows that (C) is the correct inverse. 

The fact that the numbers of the pivotal rows were the inverse of the 
numbers of the steps in the above example was more or less accidental. 
The third row was used as pivotal row in the second step because its first 
element, 3, was the largest .of the first elements in the remaining uniused 
rows. In the third step there was little choice between the first and second 
rows. So we used the second row as pivot. 

In further explanation of the unscrambling process, we consider the 
simple matrix 

"1—2 3" 

3—1 4 . 

2 1 —2 


Carrying out the inversion transformations, we have 


ri —2 

3 • 0" 


ri - 

-2 

3 

• 0 “1 




3 —1 

4 ; 1 

= 

1 — 

1/3 

4/3 

; 1/3 




2 1 

— 2 ; o_ 


2 

1 

— 2 

! ^ 






"0 

— 5/3 

5/3 

: — 1 / 3 "] 




z=: 

1 

- 1/3 

4/3 

: 1/3 

End of step 



0 

5/3 — 

14/3 

: — 2/3J 



" — 5/3 

5/3 — 

1/3 ; on 


" 0 

— 3 

- 

-1 

1 " 

- 1/3 

4/3 

1/3 ; 0 

= 

0 

2/5 

— 

■ 1/5 

1/5 

6/3 

— 14/3 — 

2/3 ; 1 


5/3 

— 14/3 

— 

- 2/3 

1 


“0 —3 — 1 ; 1 " 

0 2/5 1/5 ; 1/5 

_1 —14/5 —2/5 ; 3/5 _ 


End of step 2 


" —3 

— 1 

1 

1" 


1 

1/3 

-1/3 

-1/3" 

2/5 

1/5 

1/5 

0 

== 

2/5 

1/5 

1/5 

0 

— 14/5 

— 2/5 

3/5 

0 

-j 


— 14/5 

— 2/5 

3/5 

0 
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(A) 



1/3 — 1/3 
1/15 1/3 
8/15 —1/3 



End of step 3 


1/3 —1/3 —1/3 

1/15 1/3 2/15 Permuted inverse. 

8/15 —1/3 — 14/15 _ 


The table showing the pivotal rows for the three steps is : 

Steps: 12 3 (for rows) 

Pivot rows: 2 3 1 (for columns). 

The table shows that row 1 of the next matrix is row 2 of (A), that row 
2 is row 3 of (A), and that row 3 is row 1 of (A). Hence we have 


“l/15 1/3 2/15" 

(B) 8/15 —1/3 —14/15 . 

1/3 —1/3 —1/3 


Now looking at the bottom row of the table, we see that column 1 of 
the inverse is column 3 of (B), that column 2 is column 1 of (B), and 
that column 3 is column 2 of (B). Hence we write 

2/15 1/15 1/3” 

((^) — 14/15 8/15 — 1/3 Inverse of given matrix. 

_ —1/3 1/3 1/3 _ 


If we miilti[)ly {V) by the given matrix, we get 

10 0 “ 

0 10 , 

0 0 1 _ 


whi(‘h shows that (C) is the desired inverse. 

The reader will note that in any step of the transformation ihe number 
of the augmenting column from the unit matrix must agree with ihe 
number of the rote used as pivot. For example, if the third row of a 
matrix is the pivotal row, the matrix must be augmented by the third 
column of the unit matrix. 

The reader should also bear in mind that any row can be u^ed as pivot 
only once in the transformation. In other words, a different row must 
be used as pivot for each stej). 
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163. Solution of Equations by Matrix Methods. In matrix notation 
any system of simultaneous linear equations can be represented by the 
simple equation 

(1) Ax — Jc, 


where A denotes the matrix of the coefficients, x denotes a column matrix 
of the unknown x’s, and k denotes a column matrix of the known terms. 
On premultiplying (1) by A~^, we get 

( 2 ) x^A-^k. 

Equation (2) gives the solution of the given system. From this it is 
seen that in the solution of a system of linear equations by the matrix 
method, the chief problem is the inversion of the matrix of the coefficients. 
After the inverse matrix has been found, all the unknowns can be found 
in one short step. A few examples will show how this is done. 

Example I. Solve the system of equations 

2xi — 2.r_. -f- 4^*3 = — 12 
^ 2xi -j- 3jr > 2.r3 ~ 8 

— x, -!- r.— a-;, = 7/2. 

Solution. In matrix form this system is written 


“2—2 4“ 




'—12 " 

2 3 2 



= 

8 

— 1 1 — 1 j 


_ 


7/2 _ 


The matrix of the coefficients is the same as Example 1, Art. 162, wherein 
the inverse matrix was found to be 


“—1/2 1/5 —8/5“ 

0 1/5 2/5 

1/20 1 _ 


Hence by (2) we have 




--1/2 

1/5 

— 8/5r 


“—12 ■ 

x.. 

= 

0 

1/r) 

2/5 

1 

X 

8 

__ 


1/2 

0 

1 

1 J 


7/2 _ 


On performing the indicated multiplication in the right member, we get 


“n 





" 6 + 8/5 — 28/5" 


2 " 

0 + 8/5+ 7/5 

= 

3 

6+ 0 + 7/2__ 


_-5/2_ 
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Hence 

a:i = 2, 0:2 = 3, 2:3 = — 5 / 2 . 

Example 2. Solve the system 

^ 0 : — 2^ + 32 + 4^ = 9/2 
3a:— i/ + 22 + 5< = 19/2 
2o: + — 52 + < = 15 

4r4-2y— 2 + 3< = 12. 

Solution. Here we have 


“ 1—2 3 
3—1 2 

2 4—5 

4 2—1 


r 


9 / 2 “ 

y 


19/2 

z 


15 

L ^ 


12 _ 


The matrix of the coefficients is seen to be the same as the matrix of 
Example 4, Art. 162, whose inverse was found to be (C). Then by (2) 
we have 


X “ 


"—6/5 

11/10 

— 1/4 —3/20" 


“ 9/2” 


"-1/2” 

y 


11/5 

— 13/5 

0 7/5 

X 

19/2 


2 

z 


7/5 

— 17/10 

— 1/4 21/20 

15 


— 1 

t 


3/5 

— 3/10 

1/4 —1/20 


12 

1 

3 


Hence 

a: = — 1/2, y = '^7 2 = — 1, < = 3. 


It will be seen from the above examples that the solution of a system 
of non-homogeneous linear equations by the matrix method consists of two 
distinct operations: (1) inverting the matrix of the coefficients and (2) 
premultiplying the column matrix of the known quantities by the inverted 
matrix. 

IV. SOLUTION BY ITERATION 

164. Systems Solvable by Iteration. All the preceding methods of 
solving systems of linear equations involve many subtractions of terms of 
the same order of magnitude. When such terms' are nearly equal, their 
difference is nearly zero. The inaccuracies due to this inherent weakness 
of the methods cannot be entirely avoided. The best the computer can do 
is to treat all given quantities as exact numbers, use as many significant 
figures as practicable throughout the computation, and do as little rounding 
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as possible until the final results are reached. The results will then be no 
more accurate than the given quantities, and may be much less accurate. 

The method of iteration explained in Art. 74 is free from the inherent 
inaccuracy of the preceding methods. Moreover, it is a self-correcting 
method; any errors made at any step in the computation are corrected in 
the subsequent iterations. 

Unfortunately, however, the method of iteration is not applicable to all 
systems of equations. In order for iteration to succeed, each equation of 
the system must contain one large coefficient (much larger than the others 
in that equation), and the large coefficient must be attached to a different 
unknown in each equation. This requirement is met when the large 
coefficients are along the leading diagonal of the matrix of the coefficients, 
as is sometimes the case. In solving a system of equations by iteration, 
each equation is first solved for the unknown having the large coefficient, 
thereby expressing it explicitly in terms of the other unknowns. Further 
steps in the process are best explained by examples. 


Example 1, 
( 1 ) 


Solve the following equations by iteration : 
^272:+ 6y— 2= 85 

. 62;+15y4- 72 

' x+ y + 542 = 110. 


Solution. Since these equations meet the requirement for iteration, we 
solve each equation for the unknown having the large coefficient and thus 
get the system 


( 2 ) 


^ = ^ (85 — 6y + 2) 

(a) 

y=^(72 — 6i— 22) 

(b) 


(0- 


We start the iteration by putting ,y = 0, 2 = 0 in (2) (a), thus getting 

^■> = 11 = 3 . 15 . 

Now substituting a; = 3.15, z = 0 in (2) (b), we get 


yW = ^ (72 — 18.90) = 3.54. 
Then putting a; = 3.15, y = Z.b4t in (2) (c), we get 


^(110 — 3.15 — 3.54) = 1.91. 
54 
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For the second iteration we have 

(85 — 21.24+ 1.91) =8.43 

= ^ (72 — 14.58 — 3.82) =3.5r 

*W=i (110 — 2.43 — 3.57) =1.926. 

By continuing in this manner and denoting the successive iterations by 
/i, I 2 , etc., we get tthe following table: 



X 

y 

z 

/. 

3.15 

3.54 

1.91 


2.43 

3.57 

1.926 


2.423 

3.574 

1.926 


2.425 

3.573 

1.926 

h 

2.425 

3.573 

1.926 


The solution of the system (1) is therefore 

Trzz 2.425, 3.573. z = 1.920. 

Example 2, Solve the following system by iteration: 

r 3.122.r + ().5750y — 0.1 565z — 0.0067^ = 1.571 
0. 5756.1: + 2.938y + O.llOSz — 0.0015f = 0.9275 

' — 0.1565x+0.1103y + 4.1272 + 0.2051^ = — 0.0652 
_ 0.0067X — 0.0015y + 0.20512 + 4.1 T3( — — 0.0 1 78. 


These equations meet the requirement for iteration. Solving 
the unknown having the largest coefficient, we have 

X = (1.571 — 0.5756y + 0.1.5652 + 0.0067/) 

y = (—0.9275 — 0.57 56x — 0.11032 + 0.0015/) 

( 4 ) 

z = — (— 0.0652 + 0.1565X — 0.1103i/ — 0.205 1 / ) 

4.127 

t = (—0.0178 + 0.0067X + 0.0015y — 0.20512) 

4.133 


each for 


(a) 

( 1 ') 


(<■) 

(d) 
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Putting y = 0, z = 0, t = 0 in (a), we get 




Then putting x =z 0.503, 2 = 0, ^ = 0 in (b), we get 

y<'> = (— 0.9275 — 0.5756 X 0.503 ) = — 0.414. 

<v.£73o 

To find we put a: = 0.503, y = — 0.414, i 0 in (c) and get 


2(0 = 


1 

4.127 


(—0.0652 + 0.1565 X 0.503 + 0.1103 X 0.414) = 0.0143. 


Then for /(O have 


^ (— 0.0178 + 0.0067 X 0.503 — 0.0015 X 0.414 
4.1ou 

— 0.2051 X 0.0143) = — 0.00435. 

To start the second iteration, we su Institute in (4) (a) the above values 
of y(^), z^^\ and get 

a:'2) — 0.580. 

Then 

= ^7-^ [—0.9275 — (0.5756) (0.580) — (0.1103) (0.0143) 

— (0.0015) (0.00435)] = — 0.430. 

The reader will note that as soon as a new value is found, it is used at 
once in the immediately following equations. By continuing the iteration 
as outlined above, we get the following table: 



X 

y 

2 

t 


0.503 

— 0.414 

0.0143 

— 0.00435 


0.580 

— 0.430 

0.0179 

— 0.00441 

h 

0.5834 

— 0.4307 

0.01805 

— 0.004413 

h 

0.5835 

— 0.4307 

0.01806 

— 0.004413 

h 

0.5835 

— 0.4307 

0.01806 

— 0.004413 


The solution of the system (3) is thus 

a: = 0.5835, y = — 0.4307, 2 = 0.01806, < = — 0.004413. 

After one or two iterations in an example to which the method of itera- 
tion is applicable, the changes in the computed values of the unknowns 
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should be gradual. Erratic changes will usually mean that an error of 
some kind has been made in obtaining the erratic value, and therefore the 
value should be checked before proceeding further. 


165. Conditions for the Convergence of the Iteration Process. In Art. 

75 we derived the conditions for the convergence of the iteration process 
for a system of two equations of any nature. Those results can be 
extended to systems in any number of unknowns. For example, in the 
case of the system in four unknowns 

xz=zF,(x, y, z,t) 
y = F.(x, y, z,t) 
z = F.^{x, y, z,t) 
t — F^{x, y, z,t), 

the conditions for convergence are 

dj\ dF2 I I ^ ^ ^ . 

dx dx 1 dx dx 

and three similar inequalities involving partial derivatives with respect to 
y, z, and i, respectively. On adding the four inequalities and grouping 
the terms of the resultant inequality in the vertical direction, we readily 
see that the latter inequality is satisfied by the four conditions 


dF-i 


dF, 

+ 


•f 

dF, 

dx 

+ 

dy 

dz 

dt 

dFo 


dF2 


dF., 


dF. 

dx 

dy 

dz~ 

di 

\dF:, 

1 

1 dF:, 1 

+ 

dF, 

1 

+ 

dF:, 

1 Bj" 

+ 

1 

dz 

dt 

dF, 

+ 

dF,\ 

1 

i+i 



dF^ 

dx 


dz 

+ 

dt 


Now applying these results to a system of linear •equations in which the 
coefficients are a^, Ci, \ we find 


I I “t" I I “1“ I 1 I I 

1 + I + 1 ^^2 I < 1 etc. 

Hence for a system of linear equations the sufficient conditions for the 
convergence of the iteration process are given by^ the following simple rule . 
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The process of iteration will converge if in each equation of the system 
the absolute value of the largest coefficient is greater than the sum of the 
absolute values of all the remaining coefficients in that equation. 

This rule can be applied at a glance and is seen to hold for the two 
examples worked above. 

166. Concluding Remarks, and References for Further Study. In 

the preceding pages several standard methods of solving systems of linear 
equations have been explained in sufficient detail to permit the reader to 
see the advantages and disadvantages of each. No one method can be called 
the best for any and all systems of equations that may arise. The method 
of iteration is probably the best method in all cases where it is applicable, 
provided the convergence is reasonably rapid. It is the best for these 
reasons: (1) it has no inherent inaccuracy; (2) it is self -correcting ; and 
(3) it is applicable to systems of any number of unknowns. The best of 
the remaining methods are the second version of Gauss’s method (Art. 158^ 
and the method by inversion of matrices (Art. 163). 

Additional methods of solving systems of linear equations will be found 
in P. S. Dwyer’s Linear Computations (New York, 1951) and in “Prac- 
tical Solution of Linear Equations and Inversion of Matrices,” by L. Pox. 
This paper constitutes the first chapter in Contributions to the Solution 
of Systems of Linear Equations and the Determination of Eigenvalues, 
being National Bureau of Standards Applied Mathematics Series 39 
(Washington, 1954). 

Further information on matrices and their application to the solution 
of systems of linear equations will be found in Elementary Matrices, by 
Frazer, Duncan, and Collar (Cambridge University Press, 1938). 

Methods of investigating the inherent errors in the solutions of systems 
of linear equations and in the values of numerical determinants have been 
given in Chapter I of this book. 

The errors associated with the inversion of matrices are discussed by P. S, 
Dwyer in Chapter 17 of his Linear Oompuiations and in a paper entitled 
“Errors of Matrix Computations,” published in National Bureau of 
Standards Applied Mathematics Series 29 (Washington, 1953). A more 
exhaustive study of the errors associated with matrix inversion will be 
found in two lengthy papers by John Von Neumann and H. H. Goldstine 
entitled “Numerical Inverting of Matrices of High Order” and published 
in the Bulletin of the American Mathematical Society, Vol. 53, No. 11 
(November, 1947) and in Proceedings of the American Mathematical 
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Society, Vol. 2 (1951). These papers are concerned primarily with 
matrices of the tenth order and higher. 

EXERCISES XVIII 

1 . Evaluate 

2— 3 1 5 

1 —2 4 3 

— 1 3 2 4 

3— 121 

by the pivotal method. 

2 . Evaluate the above determinant by the triangular method. 

3 . Solve for z by Cramer’s Rule: 

j — ly-\-2z— <=zlO 
^y — z t = 4 
2x— y + Az — 2t= 7 
+ 2y — 3z + 2i= 9. 

4. Solve the following system by the Gauss method of Art. 158: 

2.38xi + 1.95x0 — 3.27 t3 + 1.58x4 2.16 

3.21xi — 0.86x.> + 2.42.T3 — 3.20x4 = 3.28 
1.44.r4 4- 2.95x0 — 2.14x3 + 1.86x4 = 1.42 
4.1 Txi 4- 3.62.ro — 1 .68.T3 — 2.26x4 = 5.21. 

5. Plvaluate the determinant of the coefficients in the above exercise. 
Hint: Use the product of the leading coefficients of the pivotal equations. 

6. Solve Exercise 3 comf)letelY bv inverting the matrix of the coefficients. 

7. Solve Exercise 4 completely by inverting the matrix of the coefficients. 

8 . Solve the following system by the iteration process: 

0.89x + 4.32y — 0.4Tz 4- 0.95^ = 3.36 
1.13x — 0.89y 4- 0.612; 4- 5.63^ = 4.27 
6.32x — 0.733/ — 0*652 4- 1.06< = 2.95 
0.74x 4- I.OI 3 / 4- 5.282 — 0.88< = 1.97. 



APPENDIX 

VALUES OF THE PROBABILITY INTEGRAL 
2 /* * 

P * —7= I where / = )tx. 

y/ir Jo 


hx 

0 

1 

2 

3 

4 

5 

6 

7 

8 

9 

0.00 

0.00000 

00113 

00226 

00339 

00451 

00564 

00677 

00790 

00903 

01016 

0.01 

0.01128 

01241 

01354 

01467 

01580 

01692 

01805 

01918 

02031 

02144 

0.02 

0.02256 

02369 

02482 

02595 

02708 02820 

02933 

03046 

03159 

03271 

0.03 

0.03384 

03497 

03610 

03722 

03835 

03948 

04060 

04173 

04286 

04398 

0.04 

0.04511 

04624 

04736 

04849 

04962 

05074 

05187 

05299 

05412 

05525 

0.05 

0.05637 

05750 

05862 

05975 

06087 

06200 

06312 

06425 

06537 

06650 

0.06 

0.06762 

06875 

06987 

07099 

07212.07324 

07437 

07549 

07661 

07773 

0.07 

0.07886 

07998 

08110 

08223 

08335 

08447 

08559 

08671 

08784 

08896 

0.08 

0.09008 

09120 

09232 

09344 

09456 

09568 

09680 

09792 

09904 

10016 

0.09 

0.10128 

10240 

10352 

10464 

10576 

10687 

10799 

10911 

11023 

11135 

0.10 

0.11246 

11358 

11470 

11581 

11693 

11805 

11916 

12028 

12139 

12251 

0.11 

0.12362 

12474 

12585 

12697 

12808 

12919 

13031 

13142 

13253 

13365 

0.12 

0.13476 

13587 

13698 

13809 

13921 

14032 

14143 

U254 

14365 

14476 

0.13 

0.14587 

14698 

14809 

14919 

15030 

15141 

15252 

15363 

15473 

15584 

0.14 

0.15695 

15805 

15916 

16027 

16137 

16248 

16358 

16468 

16579 

16689 

0.15 

0.16800 

16910 

17020 

17130 

17241 

17351 

17461 

17S71 

17681 

17791 

0.16 

0.17901 

18011 

18121 

18231 

18341 

18451 

18560 

18670 

18780 

18890 

0.17 

0.18999 

19109 

19218 

19328 

19437 

19547 

19656 

19766 

19875 

19984 

0.18 

0.20094 

20203 

20312 

20421 

20530 

20639 

20748 

20857 

20966 

21075 

0.19 

0.21184 

21293 

21402 

21510 

21619 

21728 

21836 

21945 

22053 

22162 

0.20 

0.22270 

22379 

22487 

22595. 

22704 

22812 

22920 

23028 

23136 

23244 

0.21 

0.23352 

23460 

23568 

23676 

23784 

23891 

23999 

24107 

24214 

24322 

0.22 

0.24430 

24537 

24645 

24752 

24859 

24967 

25074 

25181 

25288 

25395 

0.23 

0.25502 

25609 

25716 

25823 

25930 

26037 

26144 

26250 

26357 

26463 

0.24 

0.26570 

26677 

26783 

26889 

26996 

27102 

27208 

27314 

27421 

27527 

0.25 

0.27633 

27739 

27845 

27950 

28056 

28162 

28268 

28373 

28479 

28584 

0.26 

0.28690 

28795 

28901 

29006 

29111 

29217 

29322 

29427 

29532 

29637 

0.27 

0.29742 

29847 

29952 

30056 

30161 

30266 

30370 

30475 

30579 

30684 

0.28 

0.30788 

30892 

30997 

31101 

31205 

31309 

31413 

31517 

31621 

31725 

0.29 

0.31828 

31922 

32036 

32139 

32243 

32346 

32450 

32553 

32656 

32760 

0.30 

0.32863 

32966 

33069 

33172 

33275 

33378 

33480 

33583 

33686 

33788 

0.31 

0.33891 

33993 

34096 

34198 

34300 

34403 

34505 

34607 

34709 

34811 

0.32 

0.34913 

35014 

35116 

35218 

35319 

35421 

35523 

35624 

35725 

35827 

0.33 

0.35928 

36029 

36130 

36231 

36332 

36433 

36534 

36635 

36735 

36836 

0.34 

0.36936 

37037 

37137 

37238 

37338 

37438 

37538 

37638 

37738 

37:838 

0.35 

0.37938 

38038 

38138 

38237 

38337 

3843ti 

38536 

38635 

38735 

38834 

0.36 

0.38933 

39032 

39131 

39230 

39329 

39428 

39526 

39625 

39724 

39822 

0.37 

0.39921 

40019 

40117 

40215 

40314 

40412 

40510 

40608 

40705 

40803 

0.38 

0.40901 

40999 

41096 

41194 

41291 

41388 

41486 

41583 

41680 

41777 

0.39 

0.41874 

41971 

42068 

42164 

42261 

42358 

42454 

42550 

42647 

42743 

0.40 

0.42839 

42935 

43031 

43127 

43223 

43319 

43415 

43510 

43606 

43701 

0.41 

0.43797 

43892 

43988 

44083 

44178 

44273 

44368 

44463 

44557 

44652 

0.42 

0.44747 

44841 

44936 

45030 

45124 

45219 

45313 

45407 

45501 

45595 

0.43 

0.45689 

45782 

45876 

45970 

46063 

46157 

46250 

46343 

46436 

46529 

0.44 

0.46623 

46715 

46808 

46901 

46994 

47086 

47179 

47271 

47364 

47456 

0.45 

0.47548 

47640 

47732 

47824 

47916 

48008 

48100 

48191 

48283 

48374 

0.46 

0.48466 

48557 

48648 

48739 

48830 

48921 

49012 

49103 

49193 

49284 

0.47 

0.49375 

49465 

49555 

49646 

49736 

49826 

49916 

50006 

50096 

50185 

0.48 

0.50275 

50365 

50454 

50543 

50633 

50722 

50811 

50900 

50989 

51078 

0.49 

0.51167 

51256 

51344 

51433 

51521 

51609 

51698 

51786 

51874 

51962 


560 
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VALUES OF THE PROBABILITY INTEGRAL 

p *= “ 7 = r where / = hx. 

v*" *'• 


hx 

0 

0.50 

0.52050 

0.51 

0.52924 

0.52 

0.53790 

0.53 

0.54646 

0.54 

0.55494 

0.55 

0.56332 

0.56 

0.57162 

0.57 

0.57982 

0.58 

0.58792 

0.59 

0.59594 

0.60 

0.60386 

0.61 

0.61168 

0.62 

0.61941 

0.63 

0.62705 

0.64 

0.63459 

0.65 

0.64203 

0.66 

0.64938 

0.67 

0.65663 

0.68 

0.66378 

0.69 

0.67084 

0.70 

0.67780 

0.71 

0.68467 

0.72 

0.69143 

0.73 

0.69810 

0.74 

0.70468 

0.75 

0.71116 

0.76 

0.71754 

0.77 

0,72382 

0.78 

0.73001 

0.79 

0.73610 

0.80 

0.74210 

0.81 

0.74800 

0.32 

0.75381 

0.83 

0.75952 

0.84 

0.76514 

0.85 

0.77067 

0.86 

0.77610 

0.87 

0.78144 

0.88 

0.78669 

0.89 

0.79184 

0.90 

0.79691 

0.91 

0.80188 

0 92 

0.80677 

0.93 

0.81156 

0.94 

0.81627 

0.95 

0.82089 

0.96 

0.82542 

0.97 

0.82987 

0.98 

0.83423 

0.99 

0.83851 


12 3 


52138 52226 52313 
53011 53098 53185 
53876 53962 54048 
54732 54817 54902 
55578 55662 55746 

56416 56499 56582 
57244 57326 57409 
58063 58144 58226 
58873 58953 59034 
59673 59753 59832 

60464 60543 60621 
61246 61323 61401 
62018 62095 62171 
62780 62856 62932 
63533 63608 63683 

64277 64351 64424 
65011 65083 65156 
65735 65807 65878 
66449' 66520 66591 
67154 67224 67294 

67849 67918 67987 
68535 68603 68671 
69210 69278 69344 
69877 69943 70009 
70533 70598 70663 

71180 71244 71308 
71817 71880 71943 
72444 72507 72569 
73062 73124 73185 
73671 73731 73791 

74270 74329 74388 
74859 74917 74976 
75439 75496 75553 
76009 76066 76122 
76570 76626 76681 

77122 77176 77231 
77664 77718 77771 
78197 78250 78302 
78721 78773 78824 
79235 79286 79337 

79741 79791 79841 
80238 80287 80336 
80725 80773 80822 
81204 81251 81299 
81674 81720 81767 

82135 82180 82226 
82587 82632 82677 
83031 83075 83119 
83466 83509 83552 
83893 83935 83977 


4 5 6 


52401 52488 52576 
53272 53358 53445 
54134 54219 54305 
54987 55071 55156 
55830 55914 55998 

56665 56748 56831 
57491 57573 57655 
58307 58388 58469 
59114 59194 59274 
59912 59991 60070 

60700 60778 60856 
61478 61556 61633 
62248 62324 62400 
63007 63083 63158 
63757 63832 63906 

64498 64572 64645 
65229 65301 65374 
65950 66022 66093 
66662 66732 66803 
67364 67433 67503 

68056 68125 68193 
68738 68806 68874 
69411 69478 69545 
70075 70140 70206 
70728 70793 70858 

71372 71436 71500 
72006 72069 72132 
72631 72693 72755 
73246 73307 73368 
73851 73911 73971 

74447 74506 74565 
75034 75092 75150 
75611 75668- 75725 
76178 76234 76291 
76736 76792 76847 

77285 77340 77394 
77825 77878 77932 
78355 78408 78460 
78876 78928 78979 
79388 79439 79489 

79891 79941 79990 
80385 80434 80482 
80870 80918 80966 
81346 81393 81440 
81813 81859 81905 

82271 82317 82362 
82721 82766 82810 
83162 83206 83250 
83595 83638 83681 
84020 84061 84103 


7 8 9 


52663 52750 52837 
53531 53617 53704 
54390 54476 54561 
55241 55325 55410 
56082 56165 56249 

56914 56906 57079 
57737 57818 57900 
58550 58631 58712 
59354 59434 59514 
60149 60228 60307 

60934 61012 61090 
61710 61787 61864 
62477 62553 62629 
63233 63309 63384 
63981 64055 64129 

64718 64791 64865 
65446 65519 65591 
66165 66236 66307 
66873 66944 67014 
67572 67642 67711 

68262 68330 68398 
68941 69009 69076 
69611 69678 69744 
70272 70337 70403 
70922 70987 71051 

71563 71627 71690 
72195 72257 72320 
72816 72878 72940 
73429 73489 73550 
74031 74091 74151 

74624 74683 74742 
75208 75266 75323 
75782 75839 75896 
76347 76403 76459 
76902 76957 77012 

77448 77502 77556 
77985 78038 78091 
78512 78565 78617 
79031 79082 79133 
79540 79590 79641 

80040 80090 80139 
80531 80580 80628 
81013 81061 81109 
81487 81534 81580 
81951 819'-'7 82043 

82407 82452 82497 
82855 82899 82943 
83293 83337 83380 
83723 83766 83808 
84145 84187 84229 



602 VALUES OF THE PROBABILITY INTEGRAL 

P “ f where t »» hx, 

VX 

hx 0 1234S6789 

1.00 0.84270 84312 84353 84394 84435 84477 84518 84559 84600 84640 

1.01 0.84681 84722 84762 84803 84843 84883 84924 84964 85004 85044 

1.02 0.85084 85124 85163 85203 85243 85282 85322 85361 85400 85439 

1.03 0.85478 85517 85556 85595 85634 85673 85711 85750 85788 85827 

1.04 0.85865 85903 85941 85979 86017 86055 86093 86131 86169 86206 

1.05 0.86244 86281 86318 86356 86393 86430 86467 86504 86541 86578 

1.06 0.86614 86651 86688 86724 86760 86797 86833 86869 86905 86941 

1.07 0.86977 87013 87049 87085 87120 87156 87191 87227 87262 87297 

1.08 0.87333 87368 87403 87438 87473 87507 87542 87577 87611 87646 

1.09 0.87680 87715 87749 87783 87817 87851 87885 87919 87953 87987 

1.10 0.88021 88054 88088 88121 88155 88188 88221 88254 88287 88320 

1.11 0.88353 88386 88419 88452 88484 88517 88549 88582 88614 88647 

1.12 0.88679 88711 88743 88775 88807 88839 88871 88902 88934 88966 

1.13 0.88997 89029 89060 89091 89122 89154 89185 89216 89247 89277 

1.14 0.89308 89339 89370 89400 89431 89461 89492 89522 89552 89582 

1.15 0.89612 89642 89672 89702 89732 89762 89792 89821 89851 89880 

1.16 0.89910 89939 89968 89997 90027 90056 90085 90114 90142 90171 

1.17 0.90200 90229 90257 90286 90314 90343 90371 90399 90428 90456 

1.18 0.90484 90512 90540 90568 90595 90623 90651 90678 90706 90733 

1.19 0.90761 90788 90815 90843 90870 90897 90924 90951 90978 91005 

1.20 0.91031 91058 91085 91111 91138 91164 91191 91217 91243 91269 

1.21 0.91296 91322 91348 91374 91399 91425 91451 91477 91502 91528 

1.22 0.91553 91579 91604 91630 91655 91680 91705 91730 91755 91780 

1.23 0.91805 91830 91855 91879 91904 91929 91953 91978 92002 92026 

1.24 0.92051 92075 92099 92123 92147 92171 92195 92219 92243 92266 

1.25 0.92290 92314 92337 92361 92384 92408 92431 92454 92477 92500 

1.26 0.92524 92547 92570 92593 92615 92638 92661 92684 92706 92729 

1.27 0.92751 92774 92796 92819 92841 92863 92885 92907 92929 92951 

1.28 0.92973 92995 93017 93039 93061 93082 93104 93126 93147 93168 

1.29 0.93190 93211 93232 93254 93275 93296 93317 93338 93359 93380 

1.30 0.93401 93422 93442 93463 93484 93504 93525 93545 93566 93586 

1.31 0.93606 93627 93647 93667 93687 93707 93727 93747 93767 93787 

1.32 0.93807 93826 93846 93866 93885 93905 93924 93944 93963 93982 

1.33 0.94002 94021 94040 94059 94078 94097 94116 94135 94154 94173 

1.34 0.94191 94210 94229 94247 94266 94284 94303 94321 94340 94358 

1.35 0.94376 94394 94413 94431 94449 94467 94485 94503 94521 94538 

1.36 0.94556 94574 94592 94609 94627 94644 94662 94679 94697 94714 

1.37 0.94731 94748 94766 94783 94800 94817 94834 94851 94868 94885 

1.38 0.94902 94918 94935 94952 94968 94985 95002 95018 95035 95051 

1.39 0.95067 95084 95100 95116 95132 95148 95165 95181 95197 95213 

1.40 0.95229 95244 95260 95276 95292 95307 95323 95339 95354 95370 

1.41 0.95385 95401 95416 95431 95447 95462 95477 95492 95507 95523 

1.42 0.95538 95553 95568 95582 95597 95612 95627 95642 95656 95671 

1.43 0.95686 95700 95715 95729 95744 95758 95773 95787 95801 95815 

1.44 0.95830 95844 95858 95872 95886 95900 95914 95928 95942 95956 

1.45 0.95970 95983 95997 96011 96024 96038 96051 96065 96078 96092 

1.46 0.96105 96119 96132 96145 96159 96172 96185 96198 96211 96224 

1:47 0.96237 96250 96263 96276 96289 96302 96315 96327 96340 96353 

1.48 0.96365 96378 96391 96403 96416 96428 96440 96453 96465 96478 

1.49 0.96490 96502 96514 96526 96539 96551 96563 96575 96587 96599 
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VALUES OF THE PROBABILITY INTEGRAL 
2 r * 

P « “ 7 = I where / * hx, 

Vir •'0 


hx 0 2 4 6 8 

1.50 0.96611 96634 96658 96681 96705 

1.51 0.9672S 96751 96774 96796 96819 

1.52 0.96841 96864 96886 96908 96930 

1.53 0.96952 96973 96995 97016 97037 

1.54 0.97059 97080 97100 97121 97142 

1.55 0.97162 97183 97203 97223 97243 

1.56 0.97263 97283 97302 97322 97341 

1.57 0.97360 97379 97398 97417 97436 

1.58 0.97455 97473 97492 97510 97528 

1.59 0.97546 97564 97582 97600 97617 

1.60 0.97635 97652 97670 97687 97704 

1.61 0.97721 97738 97754 97771 97787 

1.62 0.97804 97820 97836 97852 97868 

1.63 0.97884 97900 97916 97931 97947 

1.64 0.97962 97977 97993 98008 98023 

1.65 0.98038 98052 98067 98082 98096 

1.66 0.98110 98125 98139 98153 98167 

1.67 0.98181 98195 98209 98222 98236 

1.68 0.98249 98263 98276 98289 98302 

1.69 0.98315 98328 98341 98354 98366 

1.70 0.98379 98392 98404 98416 98429 

1.71 0.98441 98453 98465 98477 98489 

1.72 0.98500 98512 98524 98535 98546 

1.73 0.98558 98569 98580 98591 98602 

1.74 0.98613 98624 98635 98646 98657 

1.75 0.98667 98678 98688 98699 98709 

1.76 0.98719 98729 98739 98749 98759 

1.77 0.98769 98779 98789 98798 98808 

1.78 0.98817 98827 98836 98846 98855 

1.79 0.98864 98873 98882 98891 98900 

1.80 0.98909 98918 98927 98935 98944 

1.81 0.98952 98961 98969 98978 98986 

1 82 0.98994 99003 99011 99019 99027 

1.83 0.99035 99043 99050 99058 99066 

1.84 0.99074 99081 99089 99096 99104 

1.85 0.99111 99118 99126 99133 99140 

1.86 0.99147 99154 99161 99168 99175 

1.87 0.99182 99189 99196 99202 99209 

1.88 0.99216 99222 99229 99235 99242 

1.89 0.99248 99254 99261 99267 99273 

1.90 0.99279 99285 99291 99297 99303 

1.91 0.99309 99315 99321 99326 99332 

1.92 0.99338 99343 99349 99355 99360 

1.93 0.99366 99371 99376 99382 99387 

1.94 0.99392 99397 99403 99408 99413 

1.95 0.99418 99423 99428 99433 99438 

1.96 0.99443 99447 99452 99457 99462 

1.97 0.99466 99471 99476 99480 99485 

1.98 0.99489 99494 99498 99502 99507 

1.99 0.99511 99515 99520 99524 99528 

2.00 0.99532 99536 99540 99544 99548 


hx 0 2 4 6 8 

2.00 0.99532 99536 99540 99544 99548 

2.01 0.99552 995.56 99560 99564 99568 

2.02 0.99572 99576 99580 99583 99587 

2.03 0.99591 99594 99598 99601 99605 

2.04 0.99609 99612 99616 99619 99622 

2.05 0.99626 99629 99633 99636 99639 

2.06 0.99642 99646 99649 99652 99655 

2.07 0.99658 99661 99664 99667 99670 

2.08 0.99673 99676 99679 99682 99685 

2.09 0.99688 99691 99694 99697 99699 

2.10 0.99702 99705 99707 99710 99713 

2.11 0.99715 99718 99721 99723 99726 

2.12 0.99728 99731 99733 99736 99738 

2.13 0.99741 99743 99745 99748 99750 

2.14 0.99753 99755 99757 99759 99762 

2.15 0.99764 99766 99768 99770 99773 

2.16 0.99775 9977^ 99779 99781 99783 

2.17 0.99785 99787 99789 99791 99793 

2.18 0.99795 99797 99799 99801 99803 

2.19 0.99805 99806 99808 99810 99812 

2.20 0.99814 99815 99817 99819 99821 

2.21 0.99822 99824 99826 99827 99829 

2.22 0.99831 99832 99834 99836 99837 

2.23 0.99839 99840 99842 99843 99845 

2.24 0.99846 99848 99849 99851 99852 

2.25 0.99854 99855 99857 99858 99859 

2.26 0.99861 99862 99863 99865 99866 

2.27 0.99867 99869 99870 99871 99873 

2.28 0.99874 99875 99876 99877 99879 

2.29 0.99880 99881 99882 99883.99885 

2.30 0.99886 99887 99888 99889 99890 

2.31 0.99891 99892 99893 99894 99896 

2.32 0.99897 99898 99899 99900 99901 

2.33 0.99902 99903 99904 99905 99906 

2.34 0.99906 99907 99908 99909 99910 

2.35 0.99911 99912 99913 99914 99915 

2.36 0.99915 99916 99917 99918 99919 

2 37 0.99920 99920 99921 99922 99923 

2 38 0.99924 99924 99925 99926 99927 

2.39 0.99928 99928 99929 99930 99930 

2 40 0.99931 99932 99933 99933 99934 

2 41 0.99935-99935 99936 99937 99937 

2 42 0.99938 99939 99939 99940 99940 

2 43 0.99941 99942 99942 99943 99943 

2^44 0.99944 99945 99945 90946 99946 

2 45 0.99947 99947 99948 99949 99949 

2 46 0.99950 99950 99951 99951 99952 

2 47 0.99952 99953 99953 99954 99954 

2 48 0.99955 99955 99956 99956 99957 

2 49 0.99957 99958 99958 99958 99959 

2 SO 0.99959 99960 99960 99961 99961 









564 VALUES OF THE PROBABILITY INTEGRAL 


2 r i 

F » - 7 : I where / = hx. 

y/TT Jo 


hx 

0 123456789 

2.5 

0.99959 99961 99963 99965 99967 99969 99971 99972 99974 99975 

2.6 

0.99976 99978 99979 99980 99981 99982 99983 99984 99985 99986 

2.7 

0.99987 99987 99988 99989 99989 99990 99991 99991 99992 99992 

2.8 

0.99992 99993 99993 99994 99994 99994 99995 99995 99995 99996 

2.9 

0.99996 99996 99996 99997 99997 99997 99997 99997 99997 99998 

3.0 

0.99998 99998 99998 99998 99998 99998 99998 99998 99999 99999 






INDEX 


(The nuinbera refer to pages) 


A 

Absolute error, 4 

Acceleration of gravity, formula for, 47 

Accidental errors, 393 

Accuracy in determination of arguments, 
28 ‘ 

in evaluation of formulas, 24 
of addition, 10 
of averages, 11, 12 
of division, 15, 10 
of interpolation formulas, 97 
of linear interpolation, 107 
of logs and antilogs, 19 
of measurements, 420 
of multiplication, 14 
of powers and roots, 18 
of products and quotients, 14, 15, 16, 17 
of series approximations, 32 
of subtraction, 12, 13, 14 
of solution of dilTerence equations, 338, 
339 

of differential equations, 319 
of systems of linear equations, 38 
Adams, .1. C., 261, 205 
Addition, errors of, 10 
Adopted values of constants, 25 
Algebraic equations, special procedure 
for, 198 

Alternating series, error in, 34 
Analysis, harmonic, of empirical func- 
tions, 498 

Antilogarithms, accuracy of, 19, 20 
Approximate numbers, 2 
Arguments, accuracj^ in determination of, 
28 

Astronomy, practical, fundamental equa- 
tions'of, 48, 49 
Asymptotic series, 157, 408 
Average deviation, 432 
error, 429 

Averages, accuracj of, 11 
method of, 401 

B 

Backward interpolation, Newton’s for- 
mula for, 64 


Ballistic equations, 291, 292, 293 
Ballistics, fundamental equation of, 291 
Bairstow, L., 241 
Barker, J. E., 294 
Barker method, 294, 302 
how to use, 298 
Bash forth, F , 261 

Bessel’s formula of interpolation, 77,78 
for interpolating to halves, 77 
symmetrical form of, 78 
Best ty])e of empirical formula, finding, 
487 

Biermann, O., 59. 117 
Binomial series, remainder in, 35 
Block relaxation, 349 
Borel, E., 97 

Boundary-value problems, 383 
Bradley, J., 424 
Brodetsky, S., 233 

C 

r’ajori, F., 192 
Carv'allo, 247 

Caution in use of empirical formulas, 514 
in use of quadrature formulas, 159 
Central-difference formulas, 
of interpolation, 70 
quadrature, 138, 141 

geometric significance of, 141 
remainder terms in, 181 
Charlier, C. V. L., 156, 158 
Chaiivenet, W., 408 

Check formula for coefficients in root- 
squared equations, 221 
Check formulas, for 12 ordinates, 506 
for 24 ordinates, 511 
Combination of sets of measurements, 

436, 437 

Complex roots^ detection of, 222 

computation of, by Graeffe’s method, 

222 

Conditional equations, 498, 499 
Conditions for convergence of iteration 
process for algebraic and transcen- 
dental equations, 201, 209, 558 
of Picard’s method, 290 
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INDEX 


Conformal transformation, 340 
Constants, adopted values of, 25 
Convergence, conditions for, 

in iteration process, 201, 209, 557 
in Picard’s method, 290 
Cramer, Gabriel, 522 
Cramer’s rule, 522, 524 
Criterion for negligible effects, 447 
Curve, Gaussian, 401 
Cubature, mechanical, 163 
of formula for, 164 
general statement concerning, 165 

D 

Davids, Norman, 149 
Derivatives, nth, 38 

Derivatives and differences, relation be- 
tween, 59 

Detection of complex roots, 222 
Determinants, 
errors in, 44 
evaluation of numerical, 

by expansion in minors, 516 
by pivotal method, 517 
by triangular method, 519 
triangular, 519 
Deviation, average, 432 
standard, 432 

Diagonal differences and horizontal dif- 
ferences, 

relations between, 54 
Diagonal difference table, 53 
Difference equations, 327 
quotients, 327 
table, diagonal, 53 
horizontal, 54 
Differences, 53 

and derivatives, relations between, 59 

central, 70 

double, 116 

of a polynomial, 59 

two-waj% 116, 117 

Differential equations, ordinary, numeri- 
cal solution of, 

by difference polynomials, 258 
by Euler’s method, 248 
by Milne’s method, 309 
by Picard’s method, 254 
by Runge-Kutta method, 314 
partial, numerical solution of, 
by iteration, 329 
by relaxation, 343 
by Rayleigh-Ritz method, 355 
starting the solution of, 


by Euler method, 248 
by Milne’s formulas, 267 
by Runge-Kutta method, 314 
by Taylor-series method, 266 
Differentiation, numerical, 128 
partial, of tabulated functions, 130 
Direct measurements, 426 
Division, accuracy of, 15 
Double differences, 116 
general formula for, 117 
Double interpolation, 

by repeated single interpolation, 109 
formula for, 118, 119 
remainder term of, 119 
Dwyer, P. S., 558 

E 

Elliptic integrals, 30 
Emmons, 11. W., 355 
Empirical formulas, 455 
caution in use of, 514 
finding best type of, 487 
finding constants in, 

by method of averages, 461 
by method of least squares, 466 
by plotting, 455 

when both variables are subject to 
error, 484 

when residuals are w^eighted, 476 
general case of non linear formulas, 478 
Encke, J. F., 528 
Equal effects, method of, 446 
principle of, 26 

Equations, algebraic and transcendental, 
185 

location of roots of, 185, 186 
solution of, 

by interpolation, 188 
by iteration, 190, 206 
by Newton-Raphson method, 192, 203 
by repeated plotting on larger scale, 
*^190 

Equations, ballistic, 291-294 
difference, 327 
differential, ordinary, 248 

of exterior ballistics, 291-294 
of first order, 248-265 
of second order, 275-280 
special, of second order, 280-286 
simultaneous, 286-288 
partial, 321 369 
Equations, error, 401 
functional, 399 
heat conduction, 328 
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integral, 370-392 
linear, 378-382 
non-linear, 384-392 
Laplace, 327 

linear systems, accuracy of solution of, 
38 

normal, 468 
Poisson, 328 
probability, 401 
residual, 467, 469 
simultaneous linear, 516-659 
accuracy of solution of, 38-44 
numerical solution of, 
by determinants, 516-525 
by method of division by leading 
coefficients, 525-527 
by Gauss’s method, 528-533 
by inversion of matrices, 533-553 
by iteration, 553-558 
Error, average, 429 

oflFect ot, in tjibular value, 57 
equation, 401 
function, 397 

inherent in Gauss’s quadrature for- 
mula, 182 

in Simpson’s Rule. 174 
in Weddle’s Rule, 180 
in solution of difference equations, 
338 

mean square, 427 
probable, 428 

Errors, general formula for, 9 
in addition, 10 
in determinants, 44 
in division, 15 
in logarithms, 19 
in multiplication, 14 
in powers and roots, 18 
in solution of diflFerential equations, 
319 

in solution of simultaneous linear 
equations, 39-44 
in subtraction, 12 
percentage, 4 

probability of, between given limits, 
395 

propagation of, 444 
relative, 4 
systematic, 393 

Euler’s method of solving differential 
equations numerically, 248 
modified, 250, 300 
Euler’s quadrature formula, 157 
inherent error in, 183 


remainder term in, 183 
Evaluation of determinants, 510 
of formulas, accuracy in, 24 
the two problems in, 24 
of probability integral, 406 
Experimental data, smoothing of, 489 
Exponential series, remainder in, 35, 36 

F 

False position, method of, 188 
Figures, significant, 2 
Finding best tyy)e of empirical formula, 
487 

Formulas, check, 506 
empirical, 455 
Milne, 310 

non-linear empirical, 478 
Forward interpolation, formula for, 63 
Frazer, C'ollar, and Duncan, 558 
Function, error, 397 
(Green’s, 373 
table, 109 

Functional equation, 399 
Fundamental equation for errors in argu- 
ments, 29 

of exterior ballistics, 292 
G 

Cans, R., 321 

(.aiiss, C. F., 127, 145, 528 
Gaussian curve, 401 

Gau-^s’s method of solving simultaneous 
linear equations, 528-533 
quadrature formula, 145 
disadvantages of, 152 
inherent error in, 182 
Geometric significance of 

central-dillerence quadrature formulas, 
141 

\e^^ton-Kaylhson method, 194-195 
precision measures, 431 
Simyison’s Rule, 133 
Weddle’s Rule, 134 
Weierstrass’s theorems, 52 
Geometry of iteration, 202 
Goldstine, H. H., 558 
Goursat, E., 371, 383 
G(nirsat -Hedrick, 168 
Graefl’e, 185, 213 

Graetfe’s root-squaring metht’ I, 213 

Brodetsky and SmeaFs improvement 
of, 233 

for comy)lex roots, 222 
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for equal roots, 231 
for real roots, 216 
principle of, 213 

Rainbow’s check for coefficients in, 220 
Graphic method of determining constants 
in empirical formulas, 455 
of solving equations, 185 
Gravity, formula for acceleration of, 47 
Gregory, J., 63 
Green’s function, 373 
Grouping of equations, 463 

H 

Halves, formula for interpolating to, 77 
Halving the interval, 272 
Harmonic analysis of empirical func- 
tions, 498 

Heat-conduction equation, 328 
Hermite’s formula, 125 
Horizontal difference table, 54 

I 

Improvement of Graeffe’s method, 233 
Improvement of roots found by Graeffe’s 
method, 245 

Index of precision for errors, 401 
for residuals, 421 
Indirect measurements, 426 

the two fundamental problems of, 446 
Inherent error in Gauss’s quadrature 
formula, 182 

in Newton-Raphson method, 197 
in prismoidal formula, 171 
in Simpson’s Rule, 174 
in solution of partial differential equa- 
tions by difference equations, 338 
in Weddle’s Rule, 180 
Integral equations, 255, 370 
linear, 378 
non-linear, 383 
Integrals, elliptic, 30 

Integrating ahead, formulas for, 260-261 
Integration, numerical. Hee Numerical 
integration 

Interpolation, deOnition of, 51 
accuracy of, 07 
backward, formula for, 65 
Bessel’s formulas for, 77, 78 
forward, formula for, 63 
double, 109-125 
inverse, 88 

Lagrange’s formula for, 86 
aeries, 97 

to halves, formula for, 77 


trigonometric, formula for, 125 
Interval, halving the, of h, 272 
Inverse interpolation, 88 
by Lagrange’s formula, 89 
by reversion of series, 92 
by successive approximations, 89 
Iteration, method of, for finding roots, 
199 

for solving difference equations, 329 
for solving integral equations, 255, 370 
for solving systems of linear equa- 
tions, 553 

process for algebraic and transcenden- 
tal equations, 199, 206, 388 
convergence of, 201, 209, 210, 557 
rule for, 558 
geometry of, 202 

and relaxation methods compared, 353, 
354 

J 

.Tahnke and Emde, 30 
K 

Kernel, of integral equation, 370 
Kooy, J. M. d., 299 
Kutia, W., 315 

L 

Lagiangt‘’H formula of interpolation, 86 
remainder term in, 98, 99, 103 
uses of, 87 
Lattice points, 325 
Law of accidental errors, 393 
Law of erior of a function, 401, 405 
for residuals, 420 

Least squares, method of, 466, 408, 476 
j)riTiciple of, 415, 417 
Levinson, A., 149 
T..icbmann, H., 324 

Linear equations, scdiition of simultan- 
eous algebraic, 510-559 
accuracy of solutions of, 38 
function, law of error of, 401, 405 
integral equations, 378 
interpolation, accuracy of, 107 
with several arguments, 119 
Lobatto, 152, 183 
Tiobatto’s quadrature formula, 152 

application of in solution of integral 
equations, 386 

T^ogarithmic series, remainder in, 37 
paper, 458, 460, 488 
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Logarithms, accuracy of, 19 
Lovett, W. V., 383 
Lowan, A. N., 149 
Ltiroth, J., 32 

M 

Maclaurin*fl series, remainder term in, 38 
Malmaten*8 formula, 183 
Matrices, addition and subtraction of, 534 
column, 534 
inversion of, 540-551 
multiplication of, 

by a number or scalar, 535 
by another matrix, 536-539 
unscrambling of, 546, 549-551 
unit, 534 

Matrix, deOnition of, 533 
of coefficients, 536 
inverse, 540 
non-singular, 540 

Maxima and minima of tabulated func- 
tions, 129 

Mean, weighted, 418 
Mean square error, 427 
Measurements, direct, 426 
indirect, 426 
rejection of, 452 
Measures of precision, 427 

computation of, from residuals, 435, 
436 

geometric significance of, 431 
relations between, 430 
Mechanical quadrature, definition of, 131 
Mechanical cubature, 131, 163 
general rule for, 165 
Membrane, vibrating, 363 
Method of averages, 461 

of Barker for starting trajectories, 302 
of equal effects, 446 
of Euler, 248 
of false position, 188 
of Graeffe, 213 

of interpolation, for finding roots, 188 
of iteration for finding roots, 199, 206, 
207, 553 

for solving difference equations, 329 
for solving simultaneous linear equa- 
tions, 553 

of least squares, 466, 468, 476 
of Milne, for solving differential equa- 
tions, 309 

of Picard, for solving differential equa- 
tions, 254 
of relaxation, 343 


of Runge and Kutta, 271, 314 
of selected points for finding constants 
in empirical formulas, 455 
pivotal, of evaluating determinants, 
617 

Rayleigh-Ritz, 355 

Stormer, for special second-order equa- 
tions, 282 

triangular, of evaluating determinants, 
519 

Methods of solving partial differential 
equations, 324-360 

of solving simultaneous linear equa- 
tions, 516-558 

of starting solutions of differential 
equations, 265, 294 
Miller, F. H., 356 
Milne, W. E., 267, 309 
Milne’s method for solving differential 
equations, 309 

formulas for starting the solution of 
a differential equation, 268 
formulas for solving differential equa- 
tions, 310 
Mistakes, 393 

Modulus 01 complex roots, theorem re- 
lating to, 229 
Montel, P., 97 
Moors, B. P., 149, 183 
Moulton, F. R., 265, 294 
Multiplication, accuracy of, 14 

N 

Negligible effects, criterion for, 447 
Networks, triangular, 348 
Newton, I., 192 

Newton Raphson method of solving equa- 
tions, 192 
convergence of, 203 
for simultaneous equations, 203 
geometric significance of, 194 
inherent error in, 197 
Newton’s formula (II) for backward 
interpolation, 05 
(I) for forward interpolation, 63 
Non-linear empirical formulas, 478 
integral equations, 383 
Normal equations, 468, 476 

rule for writing down, 468, 476 
Normal probability curve, 395, 401 
Numbers, approximate, 2 
roundc^ 2 

Numerical differentiation, 128 
Numerical integration, 131-173 
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by central'difference quadrature formu- 
las, 137 

by Euler’s formula, 156 
by Gauss's formula, 145 
by Lobatto's formula, 152 
by Simpson's Rule, 132 
by Tchebycheff's formula, 165 
by Weddle's Rule, 133 
Numerical solution of ordinary differen- 
tial equations, advantages and dis- 
advantages of, 321 
by approximating polynomials, 258 
by Euler’s method, 248 
by Milne's method, 309 
by Picard's method, 254 
by Runge-Kutta method, 314 
starting the, 265, 295 
of second order with first derivative 
absent, 280 

Numerical solution of partial differential 
equations, 
by iteration, 329 
by relaxation, 343 
by Rayleigh-Ritz method, 355 
Nystrom, E, J., 371 

0 

Observations, rejection of, 452 
smoothing of, 489 
weighted, 415 
Overrelaxation, 348 

P 

Palmer, A. de F., 26, 447, 448 
Partial derivatives of tabulated func- 
tions, 130 
Pearson, K., 125 
Percentage error, 4 
probable error, 445 
Period other than 27r, 513 
Picard, method, 254 
solution, 288 
Pivotal element, 517 
equation, 525, 528 

method of evaluating determinants, 
514-516 

Plotting, method of repeated, 190 
Points, lattice, 325 

method of selected, 455 
Poisson's equation, 328 
Poliak, L. W., 513 
Polynomial, differences of a, 59 

when nth differences are constant, 489 
Polynomials, approximating, 258, 259 


Pope, Alexander, 45 

Postmultiplication and premultiplication 
of matrices, 539 

Powers and roots, accuracy of, 18 
Practical astronomy, fundamental equa- 
tions of, 48-49 

Precision and accuracy, difference be- 
tween, 426 
index for errors, 401 
for residuals, 421 
measures, 427 

computation of, from residuals, 435, 
436 

geometric significance of, 431 
relations between, 430 
Principle of equal effects, 26 
of Graeffe’s methods, 213 
of least squares, 415-417 
Prismatoid, definition of, 170 
Prismoid, definition of, 168 
Prismoidal formula, 169 
Prismoids and prismatoids, difference 
between, 170 

Probability equation, for errors, 401 
for residuals, 421 
curve, normal, 395 
integral, evaluation of, 406 
tables of, 560-504 

of errors lying betw^een given limits, 
395 

of hitting a target, 407 
Probable error, computation of, from 
residuals, 433 
definition of, 428 
formulas fur, 433, 430, 444, 445 
in indirect measurements, 444, 445 
meaning of, 442 

of arithmetic and weighted means, 433 
of a function whose p.e.’s are known, 
443 

Probable error and weight, relation be- 
tween, 432, 433 

Probable percentage error, 445 
relative error, 444, 445 
Product, accuracy of, 14 
relative error of, 14 
Propagation of errors, 444 

Q 

Quadrature, mechanical, 131 

formulas, caution in use of, 159 
central difference, 138, 141 
Euler's, 157 
Gauss's, 145 
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general, for equidistant ordinates, 131 
Lobatto’s, 152 
Simpson’s, 132 
Tchebycheff’s, 155 
Weddle’s, 133 
Quotient, accuracy of, 15 
relative error of, 15 
Quotients, difference, 325 

R 

Rainbow, R., 220, 222 
Rainbow’s check formula, 221 
Range, of projectile, 308 
Raphson, 192 

Rayleigh, Lord (J. W. Strutt), 356 
Rayleigh- Ritz method, 355 
Reciprocals of roots, relations between 
coefficients and, 225 
Regula falsi method, 188 * 

Rejection of observations and measure- 
ments, rule for, 452 
Relation between, 

differences and derivatives, 59 
precision measures, 430 
probable error and weight, 432, 433 
roots and coefficients, 210, 225 
Relaxation, block, 349 
method of, 343 
Relative error, 4 

and significant figures, relation be- 
tween, 4 

theorems concerning, 5-8 
of a product, 14 
of a quotient, 15 
j)robable, 445 
Remainder term, 

in Bessel’s formulas, 101, 102, 103 
in binomial series, 35 
in central -difference quadrature formu- 
las, 181 

in Euler’s formula, 183, 184 
in formula for interpolating to halves, 
102, 103 

in flauss’s formula, 182 
in T>agrange’s formula, 98, 103 
in linear interpolation, 107 
in Newton’s formula (I), 98, 99, 102 
in Newton’s formula (TI),99, 100,102 
in Sim])son’s Rule, 170, 177, 178 
in Stirling’s formula, 100, 101, 103 
in Weddle’s Rule, 180 
Repeated plotting, method of, 190 
Residual, 343, 417, 401 
equations, 402, 467 


Residuals, 417, 461 

in terms of errors, 422, 423 
law of error for, 420 
of measurements, 455 
of plotted points, 461 
probability equation for, 421 
sum of, theorem concerning, 419 
weighted, 474, 475, 476 
Rice, H. L., 59, 61 
Richardson, L. F., 324 
Ritz, W., 356 
Rockets, 298 

Roots, complex, detection of, 222 
computation of by interpolation, 188 
by iteration, 199, 206 

Newton -Raphson method, 192, 203 
by regula falsi method, 188 
by repeated plotting, 190 
finding a]»proximate values, of, 185 
Graeffe’s method for finding, 213 
location of, 185 
real and equal, 231 

Root-squaring process, principle of, 213 
rule for applying, 216 
when to discontinue, 217, 218 
Rounding of numbers, rule for, 3 
Runge, r , 314, 505 
Runge and Konig, 233, 318, 500 
Runge-Kutta method, 271, 314, 324 
^or first-order equations, 314 
for second-order equations, 316 
for simultaneous equations, 317 
inherent error in, 317 
special case of, 315 
Running, T. R., 513 

S 

Scheme for 12 ordinates, 498 
for 24 ordinates, 508 
Semi-logarithmic paper, 459, 460 
Scries, alternating, error in, 34 
asymptotic, 157, 408 
binomial, remainder term of, 35 
exponential, remainder term in, 36 
interpolation, 97 

logarithmic, remainder term in, 37 
Maclaurin’s, remainder term in, 33 
Taylor’s, remainder term in, 32, 33 
Series approximations, accuracy of, 32 
Sets of measurements, combiration of, 
when p.E.’s are given, 436, 437 
Shortley, G. H., 324 
Significant figures, 2 

in powers, roots, logs, and antilogs, 21 
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in products and quotients, 21 
loss of, by subtraction, 12 
relation of, to relative error, 5-8 
Simpson’s Rule, 132 

formulas for inherent error in, 176, 
177, 178 

geometric significance of, 133 
Simultaneous equations, 

algebraic and transcendental, 203 
differential, 286 

linear, accuracy of solutions of, 38 
solution of, 

by determinants, 516 
by division by leading coefficients, 
525 

by Gauss method, 528, 530 
by inversion of matrices, 552 
by iteration, 553 
Smeal, G., 233 
Smithsonian tables, 127 
Smoothing formulas, 401, 402 
Southwell, R. V., 324, 355 
Special equations of second order, 280 
Special procedure for algebraic equations, 
198 

Standard deviation, 432 
Starting a solution, methods of, 265 
Starting values, methods of finding, 294 
Steffensen, J. F., 38, 97 
Stirling’s formula of interpolation, 74 
as a power series, 93 
compared with Bessel’s 81 
when to use, 82, 104 
Stormer, C., 282 
Stormer’s formula, 282 
String, vibrating, 356 
Strutt, J. W., 356 
Subtraction, accuracy of, 12, 13 

loss of leading significant figures by, 12 
Systematic errors, 393 
Systems of algebraic and transcendental 
equations, 203 

of differential equations, 286 
of linear algebraic equations, 516-559 
accuracy of solution of, 38 
of special second-order equations, 286 

T 

'I'able, function, 109 
Tables of differences, 53, 54, 55 
of pn)bability integral, 560-564 
Tabular value, effect of error in, 57 
Tannery, J,, 2 

Target, probability of hitting, 407 


Taylor’s formula, remainder term in, 32, 
33 

Tchebycheff, P., 155, 183 
Tchebycheff’s formula, 155 
Theory and experience, agreement be- 
tween, 424 

Todhunter, I., 147, 182 
Transformation, conformal, 340 
Trapezoidal Rule, 137 
Traverse, 330 

Triangular determinant, 519 

method of evaluating determinants, 519- 
520 

networks, 348 

Trigonometric interpolation, 125 
series, case of 12 ordinates, 498 
case of 24 ordinates, 508 
3’wo-way differences, 116, 117 

U 

Tytenbogaart, J. W. H., 299 
V 

Valine Poussin, C. J. de la, 59, 156, 175, 
331 

Value of h for stipulated accuracy in 
integral, 179 
Van Orstrand, C. E., 477 
Vibrating membrane, 363 
string, 356 

Von Neumann, John, 558 
W 

Weddle’s Rule, 133 

geometric '«^ignifu•Jlnce of, 134 
inherent error in, 180 
We iers trass, K., 52 
two theorems of, 52 
Weight, definition of, 416 
of a function, 475 

Weight and probable error, relation be- 
tween, 432, 433 
Weighted mean, 418 

normal equations, rule for writing 
down, 476 
observations, 416 
residuals, 474, 475, 476 
Weller, R., 324 
Wentworth, G. A., 463 
Whittaker and Robinson, 109, 156, 492 
Whitworth, W. A., 463 
Willers, F. A., 318, 324 
Wilson, E. B., 168, 331 



ANSWERS TO EXERCISES 


I, Page 46 

1. 63.85, 93490 or 9349 X 10, 0.006394, 

83620 or 8363 X 10, 3630 X 10*, 0.09004, 

53910 or 5391 X 10. 

2. Beam measurement. 3. 571. 4. 5529 or 5528. 

6. 6804.0 or 6804.1. 6. 0.0206850. 

7. Between 860 and 865. 8. 9 ft./sec. 

9. 37.1 ± 1.4 ft./sec. 

10. 6,250,000 ft. lbs.; 6,211,180 ft. lbs.;. 

6,216,972 ft. lbs. 

dl dT 

11. j = 0.00025, -Y = 0.000125. 

/It /ih 

12. 100 —=0.177; 100^=0.98. 

r ft 

13. = 0.00106 radian = 3' 39". 

14. 0.1%. 15. dL = r 

16. dh = 0'.5, dt = 0.144 radian = 0>>.553 = 33'" 2». 

17. dLy = 18".9, dLi = 45".4, dAi = 30".6, dA. = 30".6. 

18. For A = 10°, dL = 1' 21"; 
for A = 80°, dL = 12' 54". 

19. (a) (iA = 29".5, d< = 14».8; 

(b) dh= 7".8, dt,= Qk7. 

20. For A = 10°, dt = 145».2 = 2"' 25».2 ; 
for A = 80°, dt = 9».9. 

21. For A = 10°, dL = 3".0, . dh = 3".0 ; 

for A = 80°, dL = 1' 37".8, dh = 17".0. 

22. For A = 10°, dL = I'.l ; 
for A = 80°, dL = 9'.0. 

23. Afc is most potent as i increases. 

24. 0.77210. 25. 1.5051. 
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26. a?= 1.9273537, A® = ±0.052; 

y = — 2.0198504, Ay = ip 0.049 ; 
z = 0.7584232, A;? = zp 0.0602. 

Hence we take x = 1.9, y = — 2.0, z = 0.8. 

27. X = 0.359496660, Ax = ± 0.00872 ; 

y = 0.444855496, Ay = :;: 0.00066 ; 

z = 0.712148773, Az = 0.00242 ; 

u = — 1.122082546, Au=± 0.00097. 

Hence we take 

ir = 0.36, y = 0.445, 2 = 0.71, w = — 1.122. 

sfc jts . dt). 

8inA;sm^(<i — <s)cos«2 8)n^(<i — <.) 

29. 7'.4. 

II, Page 68 

1. 65540 should be corrected to 65536. 

2. Fourth line should be 59".8. 

3. 8.0363956 — 10. 4. 261° 54' 14".7. 

5. 8.0891991 — 10. 6. 274° 43' 22". 

III, Page 83 

1. 8.2175401 — 10. 2. 0.691960629. 

3. 0.6448325. 4. 1' 52".4. 6. 12° 55' 12".94. 

8. 0.436185128. 

IV, Page 95 

1. yz= 15.79; a: = 97.66. 2. 0.73811340. 

V, Page 108 

1. Ex. 3, ie» = 0.030; Ex. 4, if. = 0".023. 

2. Ex. 2, if. = 0.015 ; Ex. 3, E. = 0.16 ; 

Ex. 4, Rn — 0.00117 ; Ex. 6, if. = 0.055. 



ANSWERS TO EXERCISES 


STS 


1. 6‘'48“25*. 


VI, Page 127 


VII, Page 171 

1. 6.6072. 2. 0.4623. 3. 6'' 5” 21'.9 A. M., June 22. 

4. By Simpson’s Buie, 1.505103; 
by Weddle’s Rule, 1.505103. 

6. 0.9289011. 6. 293.4. 7. 1.010784. 

8. 0.90452. 9. 0.113822. 10. —0.09485. 

11. 0.9480, by Simpson’s Rule. 12. 0.13340. 

13. (a) 0.3585; (b) 0.3201; (c) 0.3104; (d) 0.2444. 

IX, Page 211 

3. 3.7893. 4. 6.1647. 6. 2.883238. 6. 0.12243. 

7. 1.723. 8. 0.93825. ' 9. 0.15368. 

10. 2.138, — 1.069 ± 2.257t. 11. 1.0649. 

12. 1.44575. 13. * = 0.22684, y = 0.36962. 

14. * = 0.567325, y = 1.857378. 

15. ± 0.20292, ± 0.37077, ± 0.47455. 

X, Page 234 

1. —3.5616 ± 2.493i, —0.0284 ± 0.3241i. 

3. 5.2555, 0.9676 ± 0.3272i, 

— 0.7870 ± 0.5764i, 0.3833. 

4. —1.5818592 

0.5664427 ± 1.3686572 1 
0.9623278 ± 0.713.5689 i 

— 0.7378408 ± 0.8124513 1. 

5. —5.6248 

— 1.1212 ± 0.9752 i 

— 0.7446 ± 1.2417 1 

— 0.2697 ±0.9600 i 
2.1748. 

XIII, Page 410 

3. 0.331. 5. 0.00115; 870. 
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ANSWERS TO EXERCISES 


XIV, Page 427 

1. r = 0.0071 ; = 0.6639 ± 0.0022. 

4. il/o = 0.00356 ±i 0.00016. 6. If# = 299937 ± 44. 

7. Mo = 107.9374 ± 0.0027. 


XVI, Page 474 

1. y = 0.000000864a:»*‘“ 5. y = lOle-® 

6. y = 100.61e-» 8. a:/y = 0.1 73 + 0.0660X. 


12 . 



= 0.0152778 + 0.0014414*. 


13. R = 


58.275 

0.010133 + tan A ' 


XVIII, Page 538 

1. 239. 2. 239. 3. « = 3. 4. *, = 0.8072, *, = 0.2372, *, = — 0.1046, 
*4 = — 0.3581. 5.79.98. 6. * = 2, y = — 1, « = 3, t = 5. 8. * = 0.444^ 
y = 0.563, * =0.324, t = 0.723. 




